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Report  No.  D2002-107  Jnne  14,  2002 

(Project  No.  D2001AB-0105) 

Army  Transition  of  Advanced  Technology 
Programs  to  Military  Applications 


Execntive  Snmmary 


Who  Shonld  Read  This  Report  and  Why?  Science  and  technology  officials  in  the 
Office  of  the  Secretary  of  Defense  and  the  Department  of  the  Army  should  read  this 
report  because  it  evaluates  the  Army’s  current  process  for  enhancing  the  likelihood  that 
emerging  technology  would  reach  the  warfighter. 

Background.  Congress  and  DoD  officials  have  voiced  concern  that  technology  has  not 
quickly  transitioned  to  the  warfighter.  A  goal  of  the  Department  of  the  Army  is  to 
modernize  its  forces  by  introducing  technology  capabilities  at  a  more  rapid  pace  without 
incurring  the  need  for  additional  funds.  In  October  1999,  the  Army  announced  its  new 
Objective  Force  initiative  to  develop  a  more  mobile  and  responsive  force  that  is  able  to 
deploy  troops  anywhere  in  the  world  in  a  short  period  of  time.  To  help  achieve  the 
objective,  the  Army  had  about  260  separate  funded  advanced  technology  projects  or 
tasks  from  FYs  1999  through  2001,  with  an  average  aggregate  funding  level  of  more 
than  $700  million  to  develop  capabilities  for  introduction  to  military  applications. 

Results.  Acquisition  program  officials  were  not  adequately  involved  in  fully 
facilitating  and  supporting  the  successful  and  timely  transition  to  the  warfighter.  We 
reviewed  20  science  and  technology  projects  with  expenditures  of  $441.5  million  that 
included  6  advanced  technology  demonstration  programs  and  14  science  and  technology 
objective  programs.  Improvements  were  needed  because; 

•  none  of  the  18  projects  had  formally  agreed  to  technology  readiness  levels, 

•  five  science  and  technology  projects  that  were  advanced  technology 
demonstrators  did  not  have  acquisition  program  funding  necessary  for 
transitioning,  and 

•  of  two  science  and  technology  projects  that  transitioned  with  expenditures  of 
$36.3  million,  one  did  not  meet  the  exit  criteria  before  it  transitioned  and  the 
other  required  substantial  additional  development  by  the  receiving  acquisition 
program  office. 

As  a  result,  unless  recommended  measures  are  undertaken  to  effectively  coordinate 
formal  acquisition  program  support  for  the  18  science  and  technology  projects  that  have 
planned  additional  funding  of  $244.4  million,  the  Army  cannot  make  folly  informed 
and  prudent  decisions  on  whether  continued  investment  is  warranted.  See  the  Finding 
section  for  the  detailed  recommendations  (finding  A). 


Management  did  not  use  the  performanee  appraisal  proeess  effeetively  to  assist  in 
aehieving  DoD  performanee  goals  and  the  Army  Materiel  Command’s  eorporate 
objeetive.  Seienee  and  teehnology  offieials’  management  performanee  plans  need  to 
inelude  teehnology  transitioning  as  a  performanee  element.  See  the  Finding  seetion  for 
the  detailed  reeommendations  (finding  B). 

Management  Comments.  The  Deputy  Assistant  Seeretary  of  the  Army  (Researeh  and 
Teehnology)  eommented  on  the  draft  report.  We  did  not  reeeive  comments  from  the 
Commander,  Army  Materiel  Command  to  the  draft  issued  on  February  25,  2002.  The 
Deputy  Assistant  Secretary  concurred  with  most  of  the  recommendations  and  stated  that 
the  recommended  policies  had  been  put  in  place  for  advanced  technology 
demonstrations  programs;  however,  science  and  technology  objective  programs  should 
not  be  held  to  the  same  standard  because  they  are  in  earlier  stages  of  development.  He 
nonconcurred  with  reviewing  technology  paths  for  technologies  included  in  the  audit, 
stating  that,  by  nature,  those  projects  will  not  always  be  successful  in  transitioning  to 
acquisition  and  only  the  most  technically  mature  efforts  should  be  planned  for 
transitioning.  The  Deputy  Assistant  Secretary  concurred  with  linking  personnel 
performance  plans  to  program  performance  and  stated  that  the  linkage  should  apply 
only  to  advanced  technology  demonstration  managers  and  not  to  the  less  mature  science 
and  technology  objective  programs.  Management  comments  are  discussed  in  each 
finding  and  the  complete  text  is  included  in  the  Management  Comments  section. 

Audit  Response.  Management  comments  were  generally  nonresponsive.  We  believe 
that  there  is  no  significant  difference  between  advanced  technology  demonstration  and 
science  and  technology  objective  programs  because  both  use  advanced  technology 
development  funds.  Based  on  the  audit’s  results,  the  Army’s  policies  for  coordination 
are  not  being  followed  in  all  respects,  and  additional  Army  procedures  for  advanced 
technology  development  programs  need  to  be  issued.  We  request  that  the  Assistant 
Secretary  of  the  Army  for  Acquisition,  Logistics,  and  Technology  and  the  Commander, 
Army  Materiel  Command  provide  comments  to  the  final  report.  The  comments  should 
be  received  by  July  15,  2002. 
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Background 


DoD  Acquisition  Policy.  DoD  Directive  5000.1,  “The  Defense  Acquisition  System,” 
(Incorporating  Change  1,  January  4,  2001)  October  23,  2000,  states  that  science  and 
technology  (S&T)  projects  shall  address  user  needs.  Programs  will  be  broad  based, 
spanning  all  DoD  S&T,  to  anticipate  future  needs  and  those  technologies  not  being 
pursued  by  civil  or  commercial  communities.  The  S&T  projects  will  preserve  long- 
range  research  and  should  enable  rapid  transition  from  the  S&T  base  to  useful  military 
products.  Specific  S&T  projects  must  focus  on  increasing  the  effectiveness  of  a 
capability,  decreasing  cost,  increasing  operational  life,  and  improving  the  capabilities  of 
systems  through  planned  upgrades. 

Science  and  Technology  Guidance.  An  affordability  task  force  chartered  by  the 
Director  for  Defense  Research  and  Engineering  issued  a  handbook  and  the  Deputy 
Under  Secretary  of  Defense  (Science  and  Technology)  issued  a  guide  to  the  Military 
Departments  and  Defense  agencies  concerning  practices  that  they  believed,  if  instituted, 
would  assist  in  transitioning  technology.  In  addition,  in  response  to  congressional 
concerns  that  the  DoD  had  not  been  successful  in  transitioning  technology,  the  Under 
Secretary  of  Defense  for  Acquisition,  Technology,  and  Logistics  issued  a  report  to 
Congress  identifying  why  technology  was  not  transitioning. 

Addressing  Affordability  in  Defense  Science  and  Technology  (S&T):  A 
Handbook  for  S&T  Managers.  In  October  1999,  the  DoD  S&T  Affordability  Task 
Force  issued  a  Handbook  that  stresses  the  importance  of  early  involvement  of  all 
candidate  acquisition  programs  in  advanced  technology  efforts.  The  Handbook  states 
that  early  involvement  of  advanced  technology  candidate  acquisition  programs  in 
research  development,  design,  test  planning,  manufacture,  training,  logistics,  finance, 
and  contracts  are  essential  to  address  key  issues  that  lock  in  a  majority  of  the  life-cycle 
costs  of  programs.  The  Handbook  states  that  management  tools  for  ensuring  effective 
technology  transitioning  include  establishing  integrated  product  teams  (known  as  IPTs), 
creating  IPT  charters,  identifying  quantitative  metrics  and  key  exit  criteria,  and 
developing  a  formal  transition  plan  that  is  officially  signed  by  the  “customer”  (usually 
an  acquisition  community  member)  and  the  technology  manager.  Additional 
management  tools  include  preparing  an  approved  memorandum  of  agreement  or 
understanding  that  includes  a  funding  strategy,  which  commits  the  acquisition 
community  to  transition  the  technology. 

Technology  Transition  for  Affordability:  A  Gnide  for  S&T  Program 
Managers.  In  April  2001,  the  Deputy  Under  Secretary  of  Defense  (Science  and 
Technology)  issued  a  Guide  to  provide  S&T  program  managers  with  strategies  to 
transition  technology  to  the  acquisition  community.  The  Guide  states  that  die  transition 
of  technology  should  be  timely  (get  the  technology  in  the  hands  of  the  warfighter  as 
soon  as  possible)  and  cost-effective  (provide  the  best  technology  at  the  lowest  possible 
cost).  The  Guide  states  that  a  key  strategy  for  transitioning  technology  is  early 
coordination  between  the  S&T  project  manager  and  the  receiving  acquisition  manager 
to  promote  a  mutual  understanding  between  the  two  parties.  Early  coordination  assists 
the  S&T  project  manager’s  understanding  of  how  to  transition  the  technology  with  the 
time-phased  requirements  of  the  receiving  acquisition  manager.  The  receiving 
acquisition  manager,  in  turn,  is  kept  current  on  the  maturity  of  the  technology  and  is 
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better  able  to  plan  and  sehedule  the  teehnology  introduetion.  A  tool  for  fostering  this 
eoordination  is  to  establish  IPTs  that  involve  the  managers  of  the  eandidate  aequisition 
programs.  The  Guide  provides  that  IPTs  should  inelude  the  S&T  projeet  manager,  the 
S&T  eontraetor,  the  aequisition  manager  and  the  respeetive  eontraetor(s),  and  test  and 
evaluation  representatives.  An  IPT  should  be  formed  early  in  the  life  eyele  of  a 
teehnology ’s  development  to  address  key  issues  that  ean  greatly  affeet  life-eyele  eost 
and  the  eventual  aeeeptanee  and  implementation  of  the  teehnology.  Issues  that  the  IPT 
should  address  inelude  defining  and  agreeing  upon  quantifiable  metries,  sueh  as  eost, 
performanee,  and  sehedule;  exit  eriteria;  and  the  maturity  of  the  teehnology  at 
transition  identified  as  teehnology  readiness  levels  (TRLs)  (the  TRLs  are  deseribed  in 
Appendix  B).  The  Guide  states  that  those  issues  and  others  should  be  agreed  upon  in 
formal  doeumentation  sueh  as  memorandums  of  agreement  or  understanding  and 
teehnology  transition  plans. 

Under  Secretary  of  Defense  for  Acqnisition,  Technology,  and  Logistics 
Report  to  Congress.  In  June  2001,  the  Under  Seeretary  of  Defense  for  Aequisition, 
Teehnology,  and  Logisties  provided  a  report  to  the  eongressional  defense  eommittees 
on  teehnology  transition  from  the  Defense  Advaneed  Researeh  Projeets  Ageney.  The 
report  provided  Congress  with  the  results  of  a  review  of  the  transition  of  researeh  to  the 
Military  Departments  from  the  Defense  Advaneed  Researeh  Projeets  Ageney  and 
addressed  issues  that  were  also  applieable  for  the  Army  transition  of  researeh 
teehnology  to  aequisition  program  managers  and,  ultimately,  to  the  warfighter.  The 
report  eited  a  key  reason  for  diffieult  teehnology  transition  as  being  the  need  for 
eollaboration  among  three  diverse  groups:  the  S&T  researeher,  the  aequisition  program 
manager,  and  the  military  user.  Effeetive  transition  requires  the  groups  to  work 
together  as  a  team,  whieh  is  frequently  a  diffieult  issue.  In  addition,  for  a  teehnology 
transition  to  be  sueeessful,  the  aequisition  program  manager’s  prime  eontraetor  must  be 
supportive  of  the  teehnology  insertion,  and  the  teehnology  must  demonstrate  a  greater 
return  than  the  existing  eapability. 

Army  S&T  Process.  The  Army  Seienee  and  Teehnology  Master  Plan  (the  Plan) 
presents  the  S&T  investments  that  are  required  to  aehieve  the  Army  vision  of 
transforming  its  foree’s  eapabilities  to  dominate  the  full  speetrum  of  operations.  The 
Army  vision  is  to  ereate  an  Objeetive  Foree  eapable  of  deploying  a  eombat  brigade 
anywhere  in  the  world  in  96  hours,  a  eombat  division  in  120  hours,  and  five  eombat 
divisions  anywhere  in  30  days.  The  Army  S&T  projeets  were  reshaped  to  speed 
development  of  teehnologies  neeessary  to  aehieve  the  Army’s  transformation  vision. 

The  transformation  path  from  today’s  foree  to  the  future  Objeetive  Foree  ineludes 
ineorporating  teehnologies  into  existing  and  developing  systems.  The  Army  had  about 
260  separately  funded  advanee  teehnology  projeets  or  tasks  from  FYs  1999  through 
2001,  with  an  average  aggregate  funding  level  of  more  than  $700  million  per  year  to 
develop  eapabilities  for  introduetion  to  military  applieations. 
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Objectives 

The  audit  objective  was  to  determine  whether  the  Army  was  successful  in  transitioning 
advanced  technology  projects  to  military  applications.  Specifically,  we  examined 
whether  the  Army  had  established  a  process  to  successfully  transition  technology.  We 
also  evaluated  management  controls  in  the  Army  as  they  relate  to  the  audit  objective. 
See  Appendix  A  for  a  discussion  of  the  audit  scope  and  methodology  and  the  review  of 
the  management  control  program. 
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A.  Army  Science  and  Technology 
Process 

The  Army  S&T  management  ereated  an  extensive  management  proeess 
in  1999  to  plan,  review,  and  provide  oversight  of  teehnology  efforts  that 
were  proposed  to  transition  to  the  warfighter.  However,  improvements 
are  still  needed  beeause  aequisition  program  offieials  were  not 
adequately  involved  in  fully  faeilitating  and  supporting  the  sueeessful  and 
timely  transition  to  the  warfighter  for  18  seienee  and  teehnology  projeets 
that  had  expenditures  of  $405.2  million.^  For  example,  none  of  the 
18  projeets  had  formally  agreed  to  teehnology  readiness  levels,  whieh 
are  agreed-upon  levels  of  teehnology  maturity  development  that  are 
required  for  transitioning  to  the  reeeiving  aequisition  program  manager. 
Also,  five  of  the  seienee  and  teehnology  projeets,  whieh  were  advaneed 
teehnology  demonstrators,  did  not  have  the  neeessary  aequisition 
program  Wding  for  transitioning.  Finally,  for  the  two  seienee  and 
teehnology  projeets  that  transitioned  with  expenditures  of  $36.3  million, 
one  did  not  meet  the  exit  eriteria  before  it  transitioned  and  the  other 
required  substantial  additional  development  by  the  reeeiving  aequisition 
program  offiee.  Aequisition  program  offieials  were  not  adequately 
involved  in  transitioning  teehnologies  beeause  the  Army  S&T 
management  proeess  did  not  require  the  level  of  eoordination  between 
aequisition  offieials  that  was  advoeated  in  the  Deputy  Under  Seeretary  of 
Defense  (Seienee  and  Teehnology)  guidanee.  Speeifieally,  integrated 
produet  teams  were  not  established  or  they  did  not  inelude  aequisition 
program  managers,  the  S&T  manager  did  not  establish  formal 
agreements  with  aequisition  program  managers  that  ineluded  teehnology 
readiness  levels  and  exit  eriteria,  and  S&T  projeets  were  not  budgeted  by 
aequisition  users  to  transition.  As  a  result,  unless  measures  are 
undertaken  to  effeetively  eoordinate  the  18  seienee  and  teehnology 
projeets  that  have  planned  additional  funding  of  $244.4  million,  the 
Army  cannot  make  fully  informed  and  prudent  decisions  on  whether 
continued  investment  is  warranted. 

Army  Science  and  Technology  Review  Process 


Army  S&T  Review  Process.  The  S&T  community  has  an  extensive  technology 
planning,  review,  and  oversight  process  to  assist  the  Army  in  achieving  the 
future  Objective  Force.  The  Army  Pamphlet  70-3,  “Army  Acquisition 
Procedures,”  July  15,  1999,  (Army  guidance)  describes  the  S&T  review  process 
and  provides  discretionary  guidance  on  S&T  projects.  At  the  beginning  of  each 
fiscal  year,  the  Deputy  Assistant  Secretary  for  Research  and  Technology  and  the 
Director,  Force  Development  Office  of  the  Deputy  Chief  of  Staff  for  Programs, 
issue  guidance  on  new  technology  proposals  and  existing  technology  reviews. 


‘A  total  of  20  science  and  technology  projects  were  reviewed  with  expenditures  of  $441.5  million. 
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New  technology  proposals  are  identified  as  S&T  objectives  (referred  to  in  the 
Army  as  STOs)  and  are  reviewed  and  approved  during  Army’s  annual  S&T 
oversight  process.  The  annual  S&T  oversight  process  also  reviews  ongoing 
technology  projects^  that  have  been  in  development  for  3  years;  that  have  been 
revised  in  terms  of  cost,  schedule,  or  scope;  and  that  have  been  completed. 

The  Army  S&T  Program  received  management  direction  and  approval  from 
three  executive-level  groups  in  developing  the  Plan.  The  first  level  of  review  is 
the  Warfighter  Technical  Council,  a  one-star-level  group  that  performs  detailed 
reviews  of  all  proposed  and  ongoing  STOs,  advanced  technology  demonstrations 
(ATDs)  and  advance  concept  technology  demonstrations  (ACTDs).  The 
Warfighter  Technical  Council  is  co-chaired  by  the  Director  of  Technology, 
Office  of  the  Deputy  Assistant  Secretary  for  Research  and  Technology,  and  the 
Assistant  Chief  of  Staff  for  Combat  Development,  Army  Training  and  Doctrine 
Command.  The  Training  and  Doctrine  Command  represents  the  military  user  in 
identifying  and  supporting  areas  for  S&T  research.  The  second  level  of  review 
is  the  Army  S&T  Working  Group,  co-chaired  by  the  Deputy  Assistant  Secretary 
for  Research  and  Technology  and  the  Assistant  Deputy  Chief  of  Staff  for 
Programs  (Force  Development).  The  Army  S&T  Working  Group  provides  two- 
star-level  resolution  of  issues  and  reviews  and  approves  research  efforts  for 
STOs  and  ATDs.  The  Army’s  final  approval  level  is  the  S&T  Advisory  Group, 
a  four-star-level  group  that  is  co-chaired  by  the  Assistant  Secretary  of  the  Army 
for  Acquisition,  Logistics,  and  Technology  and  the  Army  Vice  Chief  of  Staff. 
Army  acquisition  representation  is  provided  at  all  three  reviews.  Appendix  C 
provides  a  flow  chart  depicting  the  Army  S&T  oversight  process. 

Technology  Project  Documentation.  As  part  of  the  S&T  review 
process,  S&T  project  managers  are  required  to  submit  documentation  providing 
an  overview  of  proposed  and  ongoing  projects.  The  required  documents  include 
a  project  description  chart,  a  product  description  chart,  TRLs  and  a  milestone 
chart,  and  the  Ten-Question  Quad  Chart.  Those  four  documents  are  used  as  a 
basis  for  determining  whether  or  not  a  proposed  effort  becomes  a  STO,  ATD, 
or  ACTD.  The  project  description  chart  provides  the  program  objective  and 
identifies  intermediate  milestones  and  final  product  applications  (with  metrics)  to 
Army  systems.  The  product  description  chart  identifies  the  program’s 
technologies  and  provides  additional  STO  information  such  as  affordability 
metrics  and  approval  dates  for  the  Mission  Needs  Statement  or  the  Operational 
Requirements  Document.  The  TRL  milestone  chart  provides  the  TRLs  for  the 
teclmologies  as  well  as  the  significant  high-level  metrics  that  will  be  achieved 
throughout  the  duration  of  the  technology  development.  The  Ten-Question 
Quad  Chart  identifies  the  purpose  of  the  research,  the  technology  barrier  to  be 
overcome,  the  quantitative  metrics  to  be  met,  the  TRLs  to  be  achieved,  the 
estimated  timeframes  for  the  technology  to  be  available,  and  the  office  or 
acquisition  program  that  endorsed  the  research  effort. 


^Other  technology  efforts  include  ATDs  and  ACTDs. 
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Ten-Question  Quad  Chart.  The  annual  oversight  proeess  uses  the  Ten- 
Question  Quad  Chart  as  one  of  the  key  doeuments  to  evaluate  proposed  and 
ongoing  S&T  projeets.  The  Ten-Question  Quad  Chart  provides  the  data 
neeessary  to  evaluate  the  merits  of  the  teehnology  and  is  divided  into  four 
diserete  seetions. 

The  first  seetion  deseribes  the  problem,  the  barriers  to  solving  the  problem,  and 
the  plan  to  overeome  the  barriers.  The  seeond  seetion  diseusses  how  the  S&T 
projeet  fits  into  Army  needs,  ongoing  and  eompleted  S&T  eapabilities,  and  lists 
TRLs.  The  third  seetion  provides  the  benefits  of  the  S&T  projeet  in  terms  of 
inereased  eapability  and  eost  savings,  the  transition  milestones,  the  eandidate 
aequisition  programs  or  S&T  projeets  to  reeeive  the  teehnology,  and  the  offiee 
that  endorsed  the  researeh.  The  final  seetion  provides  the  sehedule  and  the  eost 
of  major  tasks. 

The  Army  requires  that  all  S&T  projeets  have  a  teehnology  path  or  plan  that 
identifies  the  eandidate  programs  for  the  transitioning  teehnology  in  the  Ten- 
Question  Quad  Chart.  Our  review  of  the  Ten-Question  Quad  Chart  identified 
that  it  does  not  aeeurately  portray  the  teehnology  transition  paths  or  plans.  For 
example,  the  Aviation  and  Missile  Command,  Aviation  Applied  Teehnology 
Direetorate,  planned  seven  STOs  or  ATDs  for  aviation  platforms.  Aeeording  to 
the  Ten-Question  Quad  Chart,  four  of  the  STOs  or  ATDs  identified 
five  eandidate  aviation  platforms  for  the  developing  teehnology,  with  plans  for 
three  of  those  platforms  to  transition  from  FYs  2002  through  2004.  However, 
the  reeeiving  aequisition  program  managers  stated  that  they  had  not  planned, 
seheduled,  or  budgeted  for  the  teehnology  introduetion.  The  aequisition 
program  managers  stated  that  they  were  monitoring  the  STO  or  ATD 
teehnologies  and  that  when  they  believed  the  teehnologies  were  mature,  they 
would  eonsider  introdueing  the  teehnologies  to  the  aviation  platform  during  a 
seheduled  platform  upgrade.  The  introduetion  would  oeeur  if  the  funding  was 
available  and  if  the  teehnology  was  a  suffieient  upgrade  to  warrant  the 
expenditure.  The  following  are  two  examples  of  ongoing  teehnologies  that  laek 
formal  aequisition  program  support. 

Helicopter  Active  Control  Technology  STO.  The  Helieopter  Aetive 
Control  Teehnology  STO  was  proposed  to  demonstrate  a  60-pereent 
improvement  in  weapon  pointing  aeeuraey,  a  50-pereent  inerease  in  agility  and 
maneuverability,  and  a  30-pereent  reduetion  in  flight  test  time.  The  STO  Ten- 
Question  Quad  Chart  showed  that  the  S&T  was  seheduled  to  transition  to  the 
Chinook  helieopter  (CH-47)  upgrade  in  FY  2003,  the  Blaekhawk  helieopter 
(UH-60)  upgrade  in  FY  2006,  and  the  Apaehe  helieopter  (AH-64)  upgrade  in 
FY  2007.  Although  the  teehnology  was  planned  to  be  demonstrated  on  the 
Apaehe  helieopter,  the  aequisition  program  managers  for  the  Chinook, 
Blaekhawk,  and  Apaehe  had  not  prepared  detail  plans  or  budgets  for  the 
teehnology  to  be  added  to  their  helieopter  systems. 

Advanced  Rotorcraft  Transmission  II.  The  Advaneed  Rotoreraft 
Transmission  II  STO  goals  were  to  demonstrate  a  25-pereent  inerease  in  drive 
system  power-to- weight  ratio,  a  10-pereent  reduetion  in  drive  system  operating 
eost,  and  a  10-deeibel  reduetion  in  transmission-generated  noise.  The  Advaneed 
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Rotorcraft  Transmission  II  development  effort  was  eondueted  on  the  Osprey  tilt- 
rotoreraft  (V-22),  a  non-Army  helieopter.  The  Ten-Question  Quad  Chart  for 
the  Advaneed  Rotoreraft  Transmission  II  identified  the  Blaekhawk  helieopter 
(UH-60X)  in  FY  2006,  the  Comanehe  helieopter  (RAH-66)  in  FY  2006,  the 
Apaehe  helieopter  (AH-64)  in  FY  2004,  and  the  Osprey  tilt-rotoreraft  (V-22)  in 
FY  2003  as  eandidate  programs  for  the  teehnology.  However,  none  of  the 
Army  aequisition  program  managers  had  prepared  detail  plans  or  budgets  for  the 
teehnology  to  be  added  to  their  helieopter  systems. 

Although  the  S&T  annual  oversight  proeess  ineludes  representatives  from  the 
user  eommunity  (the  Army  Training  and  Doetrine  Command)  and  the 
aequisition  eommunity  (the  Army  Deputy  for  Systems  Management  and 
Horizontal  Teehnology  Integration),  eoordination  with  the  speeifie  reeeiving 
aequisition  program  managers  is  not  required,  and  therefore  makes  the  eandidate 
aequisition  systems  identified  in  the  Ten-Question  Quad  Chart  questionable.  To 
improve  the  merits  of  the  Ten-Question  Quad  Chart  and  to  enhanee  the 
likelihood  of  teehnology  transition,  the  S&T  projeet  manager  should  be  required 
to  establish  and  maintain  an  up-to-date  formal  agreement  with  the  eandidate 
aequisition  programs  that  are  identified  in  the  Ten-Question  Quad  Chart.  The 
establishment  of  a  formal  agreement  should  be  a  eondition  for  eontinued  S&T 
funding. 

Army  Science  and  Technology  Projects  Reviewed 


The  audit  examined  20  S&T  projeets  funded  with  researeh,  development,  test,  and 
evaluation  funds;  advaneed  teehnology  development  appropriations  expenditures  of 
$441.5  million  and  planned  additional  funding  of  $244.4  million  at  the  two  Army 
sites  visited.  The  20  S&T  projeets  ineluded  14  STOs  and  6  ATDs  at  either  the 
Tank-automotive  and  Armament  Command,  Armament  Researeh,  Development, 
Engineering  Center;  or  the  Aviation  and  Missile  Command,  Aviation  Applied 
Teehnology  Direetorate. 

The  audit  evaluated  the  20  S&T  projeets  and  the  extent  of  program  eoordination, 
using  the  Handbook  and  Guide,  with  the  planned  reeeiving  aequisition  program(s)  or 
other  teehnology  effort.  The  Handbook  and  Guide  eited  best  business  praetiees 
inelude  the  ereation  of  integrated  produet  teams  that  are  aeeompanied  by  an 
established  eharter.  To  be  effeetive,  the  IPTs  must  inelude  the  aequisition  program 
manager(s)  and  the  prime  eontraetor  to  faeilitate  the  teehnology  integration.  The 
Handbook  and  Guide  also  provide  for  the  formal  establishment  of  memorandums  of 
agreement  or  understanding  with  the  aequisition  program  manager(s),  ineluding 
agreements  on  TRLs  and  exit  eriteria,  and  for  eoordination  to  provide  aequisition 
programs  with  the  neeessary  funding  to  eontinue  the  S&T  integration.  The  following 
table  summarizes  the  audit  results  by  the  STOs  and  the  ATDs.  See  Appendix  D  for 
a  summary  of  the  advaneed  teehnology  development  projeets  that  we  reviewed. 
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Summary  of  Science  and  Technology  Objectives  (STOs)  and 
Advanced  Technology  Demonstrations  (ATDs)  Examined 

(ratio  shows  positive  responses  to  total  examined) 

Number  of  Oeeurrenees  Pereent  of  Oeeurrenees 
Aetion  14  STOs  6  ATDs  14  STOs  6  ATDs 


Integrated  Produet  Team 


Team  established 

7  of  14 

6  of  6 

50 

100 

Charter  approved 

Aequisition  program 

3  of  T 

4  of  6' 

43 

67 

manager  ineluded 

Aequisition  program 
prime  eontraetor 

9  of  16" 

4  of  11" 

56 

36 

ineluded 

7  of  16' 

5  of  11' 

44 

45 

Aequisition  Program  Manager 

MOA/MOU 

3  of  29'’ 

2  of  11'’ 

10 

18 

Exit  TRLs  formally  agreed 

Exit  eriteria  formally 

0  of  26' 

Oof  3' 

0 

0 

agreed 

1  of  29® 

2  of  11® 

3 

18 

Eunding  by  aequisition 

user  to  transition 

4  of  20^^ 

Oof  6" 

20 

0 

^Charters  were  established  for  projects  that  had  IPTs. 

''S&T  projects  that  established  IPTs  applied  to  more  than  one  existing  acquisition  program. 

^S&T  projects  that  established  IPTs  applied  to  more  than  one  existing  acquisition  program  prime 
contractor. 

'’The  14  STOs  and  6  ATDs  applied  to  29  and  11  existing  acquisition  programs,  respectively. 

’Two  STOs  that  applied  to  three  acquisition  programs  and  two  ATDs  that  applied  to  eight  existing 
acquisitions  programs  were  completed  before  the  requirement  for  TRLs. 

®The  number  of  STOs  that  should  have  had  funding  was  20  instead  of  29  because  for  9  STOs  funding 
documentation  was  unavailable,  the  technology  was  a  manufacturing  improvement,  or  the  user  had  not 
been  defined. 

'’The  number  of  receiving  acquisition  programs  for  ATDs  that  should  have  had  funding  was  6  instead  of 
11  because  Aviation  Applied  Technology  Directorate  officials  stated  that,  for  five  programs,  only  pieces 
of  the  Rotocraft  Pilots  Association  technology  were  to  transition. 
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Integrated  Product  Teams 


DoD  Instruction  5000.2,  Operation  of  the  Defense  Aequisition  System, 
(Ineluding  Change  1),  January  4,  2001,  requires  that  all  S&T  and  aequisition 
programs  establish  IPTs.  The  DoD  Instruetion  states  that  IPTs  are  a 
multifunetional  team  assembled  around  a  produet  or  serviees,  and  are 
responsible  for  advising  the  S&T  projeet  manager  and  aequisition  program 
manager  on  eost,  sehedule,  and  performanee  of  that  produet.  Army  aequisition 
proeedures  state  that  IPTs  are  a  management  teehnique  that  integrates  all 
aetivities,  from  produet  eoneept  through  produetion  and  field  support. 

Integrated  Product  Teams  Established.  The  establishment  of  IPTs  was 
required  for  all  the  STOs  and  ATDs;  however,  despite  guidanee  in  the 
Handbook  and  the  Guide,  only  7  of  14  STOs  established  IPTs.  All  six  ATDs 
that  we  reviewed  had  established  IPTs.  The  Army  S&T  guidanee  does  not 
require  IPTs  for  STOs,  but  does  require  IPTs  for  ATDs. 

Integrated  Product  Team  Charters.  In  addition  to  the  establishment  of  IPTs, 
the  Handbook  and  Guide  reeommend  that  eharters  be  established  for  the  teams. 
The  Handbook  states  that  IPT  eharters  provide  the  best  way  to  minimize  team 
misunderstanding.  The  Handbook  and  Guide  provide  that  eaeh  eharter  should 
inelude; 

•  The  mission  and  objeetives  of  the  team, 

•  The  metries  to  evaluate  the  team’s  progress, 

•  The  seope  of  the  team’s  responsibility, 

•  The  relationship  of  the  team  with  other  teams, 

•  The  authority  and  aeeountability  of  the  team, 

•  The  resourees  available  for  the  team,  and 

•  A  team  membership  list. 

For  the  seven  STOs  that  established  IPTs,  three  had  approved  eharters,  and  four 
of  the  six  ATDs  had  approved  eharters.  The  Army  S&T  guidanee  does  not 
require  the  establishment  of  eharters. 

Acquisition  Program  Manager  and  Prime  Contractor.  One  goal  of  the  Army 
S&T  Program  is  to  transition  teehnology  to  an  aequisition  program  and, 
subsequently,  to  the  warfighter.  To  transition  teehnology  faster,  at  redueed 
eost,  and  ensure  interoperability  with  existing  and  future  war  fighting  systems, 
the  IPT  should  inelude  the  reeeiving  S&T  projeet  manager  and  the  reeeiving 
aequisition  program  manager’s  prime  eontraetor,  as  appropriate.  For  the 
7  STOs  that  established  IPTs,  16  aequisition  programs  or  S&T  projeets  were 
identified  as  eandidates  to  reeeive  the  teehnology.  However,  only  9  of  the 
16  aequisition  programs  or  S&T  projeet  management  offiees  and  only  7  of  the 
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16  prime  contractors  were  members  of  IPTs.  For  the  6  ATDs  that  established 
IPTs,  11  acquisition  programs  or  S&T  projects  were  identified  to  receive  the 
emerging  technology.  The  11  acquisition  programs  or  S&T  projects  had 
5  prime  contractors  participating  (some  programs  had  duplicate  contractors). 

For  the  6  ATDs,  only  4  of  11  acquisition  programs  or  S&T  project  management 
offices  participated  in  the  integrated  teams.  Also,  only  5  prime  contractors 
associated  wife  the  1 1  acquisition  programs  were  represented  as  members  of  the 
ATD  integrated  teams.  The  Army  S&T  guidance  does  not  require  the  inclusion 
of  acquisition  program  officials  or  their  prime  contractors  in  IPTs  for  STO  or 
ATD  efforts. 


Role  of  Acquisition  Program  Managers 


To  improve  the  success  of  technology  transitioning,  acquisition  program 
managers  must  make  a  firm  commitment  to  transition  the  technology  to  their 
programs.  The  commitment  should  include  a  formal  and  up-to-date 
memorandum  of  agreement  or  understanding  between  the  S&T  project  manager 
and  the  acquisition  program  manager(s).  Each  agreement  or  understanding 
should  specify  the  relationship  and  the  respective  responsibilities  of  the  S&T 
project  manager  and  the  receiving  acquisition  program  manager.  The  agreement 
should  address  system  requirements,  funding,  personnel  support,  exit  criteria, 
and  TRLs. 

Memorandums  of  Agreement  or  Understanding.  The  14  STOs  identified 
29  existing  acquisition  programs  or  S&T  projects  to  which  they  could  transition 
their  technology.  Formal  memorandums  of  agreement  or  understanding 
between  the  STO  managers  and  the  receiving  acquisition  programs  or  S&T 
projects  were  available  for  only  3  of  the  29  existing  acquisition  programs  or 
S&T  projects.  The  6  ATDs  identified  11  existing  S&T  projects  or  acquisition 
programs  for  technology  transition;  however,  only  2  memorandums  of 
agreements  were  established.  Army  guidance  does  not  require  memorandums  of 
agreement  or  understanding. 

Technology  Readiness  Levels.  DoD  adopted  TRLs  in  response  to  a  General 
Accounting  Office  Report,  Best  Practices:  Better  Management  of  Technology 
Development  Can  Improve  Weapon  System  Outcomes,  issued  in  July  1999,  and 
mandated  within  the  Army  S&T  community  in  early  2000.  The  TRLs  are  an 
assessment  of  the  technical  maturity  for  an  S&T  project.  The  TRL  ratings 
range  from  one  through  nine,  with  more  mature  S&T  efforts  having  a  higher 
TRL  number  and  a  lower  risk  for  the  acquisition  program. 

Although  TRLs  were  established  for  ah  S&T  projects,  they  were  not  negotiated 
and  formally  agreed  upon  with  the  acquisition  program  managers  or  other  S&T 
project  managers.  For  the  14  STOs,  26  candidate  acquisition  programs  or  S&T 
projects  to  receive  the  emerging  technology  were  identified.  For  the  six  ATDs, 
three  acquisition  programs  or  S&T  projects  were  identified  as  potential 
receiving  candidates.  However,  none  of  the  14  STO  projects  or  the  6  ATDs 
established  formal  agreements  with  the  receiving  candidates  on  the  TRL  that  the 
technology  would  be  developed  to  prior  to  transitioning.  Army  guidance  does 
not  require  formal  agreements  on  TRLs  between  the  S&T  project  manager  and 
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the  receiving  candidate.  As  part  of  the  overall  coordination  process,  the  S&T 
project  manager  and  the  receiving  candidate  should  be  required  to  formally 
agree  on  the  TRL  to  enhance  technology  transitioning. 

Exit  Criteria.  The  exit  criteria  establish  goals  for  S&T  projects  and  determine 
the  entrance  criteria  for  the  technology  that  transitions.  The  S&T  project 
manager  and  the  acquisition  program  manager,  in  collaboration  with  the  IPT, 
should  develop  exit  criteria  that  are  appropriate  for  transitioning  the  technology. 
Exit  criteria  are  used  to  track  progress  in  technical,  schedule,  and  management- 
risk  areas.  The  14  STOs  identified  29  candidate  acquisition  programs  or  S&T 
projects,  and  the  6  ATDs  identified  11  candidate  acquisition  programs  or  S&T 
projects.  However,  only  one  STO  and  two  ATDs  formally  coordinated  the  exit 
criteria  with  the  acquisition  program  manager  or  S&T  project  managers. 

Army  guidance  does  not  require  S&T  project  managers  to  establish  formal 
agreements  with  acquisition  program  managers  or  other  recipient  S&T  efforts 
on  TRLs  or  exit  criteria.  The  Army  should  establish  a  requirement  for  formal 
agreements  with  all  planned  technology  recipients  for  continued  funding. 

Funding  By  Acquisition  User  for  Transition 


The  DoD  and  the  Services’  research,  development,  testing,  and  evaluation 
budget  is  divided  into  seven  budget  activities.  The  S&T  community  receives 
funding  from  only  the  first  three  budget  activities:  basic  research,  applied 
research,  and  advanced  technology  development.  The  acquisition  community  is 
funded  with  three  of  the  last  four  budget  activities:  demonstration  and 
validation,  engineering  and  manufacturing  development,  and  operational  systems 
development.  The  last  budget  activity,  management  support,  is  directed  toward 
support  of  installations  or  operations  required  for  general  research  and 
development  use.  S&T  projects  are  not  funded  from  the  budget  activity  fund 
appropriated  for  the  acquisition  community,  and  acquisition  programs  are  not 
funded  from  the  budget  activity  fund  appropriated  for  the  S&T  community.  The 
separation  of  research,  development,  testing,  and  evaluation  funding  between 
the  S&T  and  acquisition  communities  and  the  shrinking  of  the  research, 
development,  testing,  and  evaluation  budget  makes  coordination  between  the 
S&T  project  managers  and  acquisition  program  managers  very  critical.  If  STOs 
and  ATDs  are  critical  to  future  and  existing  weapon  systems,  and  the  technology 
is  successfully  demonstrated  using  coordinated  exit  criteria  and  TRLs,  the 
acquisition  community  must  set  funds  aside  for  transitioning. 

This  review  identified  that  receiving  acquisition  program  managers  were  not 
providing  the  funding  necessary  for  technology  to  transition.  The  14  STO  and 
6  ATD  projects  evaluated  were  all  funded  from  the  Advanced  Technology 
Development  budget,  generally  through  the  final  demonstration  of  the 
technology.  However,  only  4  of  the  20  candidate  acquisition  program  managers 
for  the  14  STOs  and  none  of  the  6  candidate  acquisition  program  managers  for 
the  5  ATDs  that  were  scheduled  to  receive  technology  had  set  aside  funding  to 
continue  development  after  the  technology  transitions  (1  ATD  had  2  acquisition 
program  candidates). 
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Formal  agreements  between  the  S&T  projeet  manager  and  the  aequisition 
program  manager  as  a  requirement  for  eontinued  S&T  funding  may  highlight 
projeets  that  are  not  likely  to  transition  beeause  the  aequisition  program  manager 
had  not  adequately  budgeted  for  the  teehnology  transition.  Without  adequate 
funding  for  teehnology  transitioning,  the  S&T  eommunity  will  not  be  able  to 
determine  whether  eontinued  investment  in  S&T  projeet  is  benefieial. 

Recent  Initiatives  and  Changes 


The  DoD  and  the  Army  reeognized  that  teehnology  has  not  transitioned  to  the 
warfighter  as  desired.  To  enhanee  the  prospeets  of  teehnology  transitioning, 
DoD  proposed  establishing  formal  teehnology  transition  agreements,  and  the 
Army  established  Direetor(s)  positions  within  the  program  exeeutive  offiees  to 
enhanee  teehnology  transitioning. 

Technology  Readiness  (Transition)  Agreements.  The  Deputy  Under  Seeretary 
of  Defense  (Seienee  and  Teehnology)  issued  interim  guidanee  on  July  5,  2001, 
that  proposed  the  use  of  a  Teehnology  Readiness  (Transition)  Agreement.  The 
Agreement  would  represent  agreements  between  the  S&T  projeet  managers  and 
the  eandidate  aequisition  program  managers  for  the  emerging  teehnology.  The 
S&T  projeet  manager  would  provide  a  deseription  of  the  teehnology  or 
eapability,  the  status  of  the  teehnology,  the  teehnology  development  strategy, 
key  teehnieal  measures  of  the  readiness  to  transition,  and  the  projeet  plan, 
ineluding  milestones  in  the  Agreement.  The  Agreement  would  also  require  the 
aequisition  program  manager  to  provide  a  deseription  of  the  aequisition 
program,  the  program  teehnology  needs,  and  an  integration  strategy  for  the  new 
teehnology.  The  S&T  projeet  manager  and  the  aequisition  manager  would  sign 
the  Agreement  and  review  it  periodieally.  The  Deputy  Under  Seeretary  of 
Defense  (Seienee  and  Teehnology)  did  not  require  the  establishment  of  an 
Agreement,  and  its  use  is  advisory. 

Army  Reorganization.  On  October  26,  2001,  the  Army  Chief  of  Staff 
reorganized  the  program  executive  officer  and  the  program  manager  structure. 
The  action  abolished  the  positions  of  the  Deputies  for  System  Acquisition, 
Aviation  and  Missile  Command,  the  Tank-automotive  and  Armaments 
Command,  and  the  Communications  Electronics  Command  and  realigned  their 
functions  and  assigned  projects  and  acquisition  program  managers  to  existing, 
reorganized,  or  newly  created  program  executive  offices.  The  reorganization 
established  a  Director  for  Science  and  Technology  (Director)  in  each  program 
executive  office.  The  Directors  will  be  responsible  for  transitioning  projects  to 
the  acquisition  community  from  the  Army  S&T  community.  The  details  of  the 
reorganization  had  not  been  determined;  however,  the  Directors  will  be 
responsible  for  management  and  oversight  of  selected  advanced  technology 
development  funding  allocated  for  S&T  activities.  The  Assistant  Secretary  will 
determine  the  amount  of  S&T  funding  that  the  Directors  for  Research  and 
Technology  will  receive. 
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Management  General  Comments  to  the  Report  and  Audit 
Response 


Management  Comments.  The  Deputy  Assistant  Seeretary  (Researeh  and 
Teehnology)  (the  Assistant  Seeretary)  stated  that  the  role  of  the  S&T  eommunity 
is  to  provide  near-term  eapability  and  far- term  foeus  for  the  future.  It  is  the 
responsibility  of  the  S&T  eommunity  to  bring  teehnology  options  to  the  table. 
Onee  the  teehnology  has  shown  an  appropriate  level  of  maturity,  the  S&T 
managers  negotiate  with  aequisition  program  managers  to  identify  appropriate 
transition  points.  When  the  aequisition  program  manager  determines  that  the 
teehnology  is  needed  and  ean  meet  the  program  sehedule,  the  aequisition 
manager  will  seek  transition  funding. 

The  report  does  not  address  the  primary  role  of  all  of  S&T  efforts,  whieh  is  to 
deliver  options  to  the  warfighters  so  that  they  ean  ehoose  the  best  approaeh 
available  at  the  time  needed.  It  is  eritieal  that  the  S&T  eommunity  be  allowed  to 
do  exploration  prior  to  diseovery  ...  to  look  at  problems  with  an  open  solution 
set,  viee  a  pre-determined  path.  The  ability  to  keep  the  options  open  is  the  main 
reason  for  not  requiring  transition  funding  for  all  S&T  efforts.  The  Army  has 
implemented  recommendations  from  the  General  Accounting  Office  Report 
“Better  Management  of  Technology  Development  can  Improve  Weapon  Systems 
Outcomes.”  The  General  Accounting  Office  recognized  that  the  S&T 
organization  has  the  responsibility  to  mature  technology  to  high  TRLs,  hence 
adoption  of  TRLs  as  a  key  indicator  of  maturity.  The  General  Accounting 
Office  report  indicated  that  the  DoD  S&T  community  is  responsible  for 
producing  generic  rather  than  weapon-specific  technologies.  Its  goal  is  to 
conduct  research,  develop  technology,  and  farm  those  efforts  for  potential 
military  applications.  The  S&T  role  is  to  show  that  the  technology  is  feasible; 
however,  transition  is  not  the  sole  purpose.  The  purpose  of  STOs  and  ATDs  is 
to  focus  on  technologies  needed  by  the  warfighter.  The  S&T  community  will 
transition  technology  if  the  Army  decides  that  it  needs  this  capability  and  has 
funds  for  its  acquisition. 

The  management  comments  also  provided  information  on  some  technology 
transitions  and  coordination  actions  that  have  taken  place  since  the  audit. 
Management  comments  included  actions  taken  to  establish  TTAs  with 
acquisition  program  managers  (Blackhawk,  Chinook,  Apache,  and  the 
Comanche  program  offices)  receiving  research  from  the  Aviation  and  Missile 
Research,  Development,  and  Engineering  Center  and  represent  roadmaps  for 
technology  consideration. 

Audit  Response.  Both  new  and  ongoing  S&T  efforts  are  spending  limited 
advanced  technology  demonstration  resources.  Technologies  should  have  a 
more  defined  path  for  transitioning  with  formal  transitioning  agreements  with 
the  acquisition  community  if  the  Army’s  goal  of  achieving  the  future  Objective 
Force  is  to  be  met.  DoD  adopted  TRLs  in  response  to  a  General  Accounting 
Office  report  and  with  the  desire  that  the  establishment  of  TRLs  would  represent 
an  agreement  between  the  S&T  and  acquisition  communities.  By  establishing 
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coordination  between  the  two  eommunities,  evolving  teehnology  in  the  S&T 
eommunity  would  do  more  than  provide  options  to  die  warfighter;  it  would 
provide  the  teehnology  eapabilities  to  the  warfighter. 

Recommendations,  Management  Comments,  and  Audit 
Response 

A.  We  reeommend  that  the  Assistant  Seeretary  of  the  Army  for  Aequisition, 
Logisties,  and  Teehnology,  for  advaneed  teehnology  development  efforts: 

1.  Require  the  establishment  of  integrated  product  teams  that 
include  representatives  from  the  candidate  acquisition  program  office(s)  and 
the  acquisition  program  office  prime  contractor(s),  where  appropriate. 

Management  Comments.  The  Assistant  Seeretary  eoneurred  and  stated  that 
the  Army  eurrently  requires  IPTs  that  involve  aequisition  and  S&T  managers  for 
ATDs,  but  that  it  would  be  neither  appropriate  nor  praetieal  for  eaeh  STO  to 
have  an  IPT.  STOs  are  programs  of  lesser  maturity  than  ATDs  and,  even  when 
sueeessful,  require  further  development  before  ereation  of  an  IPT  and  transition 
to  aequisition  would  be  appropriate. 

Audit  Response.  Although  management  eoneurred,  the  eomments  are 
nonresponsive  to  the  reeommendation  and  eonfiiet  with  the  data  in  this  report. 

As  identified  in  the  table  in  this  report  “Summary  of  Seienee  and  Teehnology 
Objeetives  (STOs)  and  Advaneed  Teehnology  Demonstrations  (ATDs) 
Examined,”  (page  8),  all  the  ATDs  had  IPTs;  however,  only  4  of  11  aequisition 
managers  were  ineluded  in  the  IPTs  for  the  ATDs.  To  enhanee  the  involvement 
of  the  aequisition  eommunity  in  evolving  teehnologies,  the  S&T  managers 
should  be  required  to  establish  IPTs  that  inelude  the  eandidate  aequisition 
program  offiee(s)  and  their  prime  eontraetor(s).  The  Department  of  the  Army 
Pamphlet  70-3,  “Army  Aequisition  Proeedures  -  Researeh,  Development,  and 
Aequisition,”  July  15,  1999,  provides  guidanee  in  the  management  of  S&T 
programs  and  the  establishment  of  IPTs;  however,  the  guidanee  is  advisory  and, 
as  sueh,  does  not  require  the  establishment  of  IPTs.  The  pamphlet  states,  “this 
pamphlet  provides  diseretionary  guidanee  on  materiel  aequisition  management,” 
and  eontinues  the  advisory  theme  by  stating,  “the  fundamental  purpose  of  this 
version  of  Department  of  the  Army  Pamphlet  70-3  remains  the  same;  provides 
advisory  guidanee  on  the  materiel  aequisition  life  eyele.” 

The  Assistant  Seeretary  stated  that  establishing  IPTs  for  every  STO  would  be 
neither  appropriate  nor  praetieal.  The  Army  makes  a  distinetion  between  STOs 
and  ATDs  even  though  STOs  and  ATDs  are  both  S&T  projeets  using  advaneed 
teehnology  development  funds  under  the  Researeh,  Development,  Test,  and 
Evaluation  appropriation.  Additionally,  STOs  eomprise  46  pereent  of  the 
Army’s  advaneed  teehnology  development  budget  for  EY  2002  and  have 
speeifie,  measurable,  major  teehnologieal  advaneements  to  be  aehieved.  Those 
advaneements  foeus  and  stabilize  advaneed  teehnology  development  efforts. 
Projeets  under  this  eategory  have  a  direet  relevanee  to  identified  military  needs, 
and  their  development  is  used  to  demonstrate  the  general  military  use.  As  sueh. 
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early  coordination  with  the  potential  recipient  acquisition  program  is  necessary 
to  enhance  the  transition  of  the  STO  technology.  The  Army’s  review  process 
requires  the  identification  of  weapon  programs  that  STO  technology  would 
transition  to  as  a  requirement  for  STO  approval  and  funding.  Early 
coordination  with  potential  acquisition  recipients  is  emphasized  not  only  in  the 
Handbook  and  Guide,  but  also  in  the  Defense  Systems  Management  College 
course,  “Technology  Insertion  in  Defense  Systems  Acquisitions.”  The 
Handbook,  the  Guide,  and  the  technology  insertion  course  do  not  advocate 
lesser  coordination  for  S&T  efforts  that  use  advanced  technology  development 
funds.  The  audit  identified  that  half  of  the  STOs  examined  had  established 
IPTs,  and  that  half  of  those  IPTs  included  representatives  from  the  acquisition 
community. 

Accordingly,  STOs  should  be  consistently  held  to  the  same  level  of  development 
coordination  as  the  ATDs.  We  request  that  the  Assistant  Secretary  of  the  Army 
for  Acquisition,  Logistics,  and  Technology  reconsider  his  position  on  requiring 
the  establishment  of  IPTs  for  ATDs  and  STOs  and  provide  additional  comments 
to  the  final  report. 

2.  Require  the  establishment  of  formal  agreements  between  the 
science  and  technology  manager  and  the  candidate  acquisition  program 
manager(s)  for  emerging  technologies.  The  formal  agreements  should 
coordinate  exit  criteria,  technology  readiness  levels,  availability  of 
transitioning  funds,  and  estimated  transitioning  timeframes. 

Management  Comments.  The  Assistant  Secretary  concurred  and  stated  that 
ATD  management  plans  are  approved  for  all  ATDs  and  document  exit  criteria, 
TRLs,  and  estimated  transition  time  frames.  The  signed  ATD  management 
plans  serve  as  the  MOA  or  MOU  between  the  S&T  community  and  die 
acquisition  manager. 

Audit  Response.  Although  management  concurred,  the  comments  are 
nonresponsive  and  conflict  with  the  data  in  this  report.  The  audit  examined 
ATD  management  plans  and  considered  them  in  developing  the  audit  results. 

The  audit  results  for  ATDs  (page  8)  contradict  management’s  comments  that 
formal  agreements  have  been  appropriately  established.  Management  comments 
also  exclude  applicability  to  STOs.  As  presented  in  the  audit  response  to 
Recommendation  1.,  formal  agreements  are  needed  for  STOs  as  well  as  ATDs. 

Further,  the  DoD  has  been  placing  greater  emphasis  on  coordinating  advanced 
technology  demonstration- funded  efforts  to  improve  technology  transitioning. 
The  Deputy  Under  Secretary  of  Defense  for  Science  and  Technology,  in  a 
July  5,  2001,  memorandum  to  the  Military  Departments  and  Defense  agencies, 
recommended  the  development  of  TRLs  and,  unlike  the  Army,  made  no 
distinction  between  emerging  technologies.  Accordingly,  we  request  that  the 
Assistant  Secretary  of  the  Army  for  Acquisition,  Logistics,  and  Technology 
reconsider  his  position  and  provide  comments  to  the  final  report  on  the 
deficiencies  identified  in  the  report  and  on  requiring  formal  agreements  for  all 
ongoing  STOs  as  well  as  ATD  efforts. 
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3.  Require  the  establishment  of  formal  memorandums  of  agreement 
or  understanding  and  technology  transition  agreements  between  the  science 
and  technology  manager  and  candidate  acquisition  program  manager(s). 

The  establishment  of  the  formal  agreements  should  be  a  requirement  for 
continued  research,  development,  test  and  evaluation  funding. 

Management  Comments.  The  Assistant  Secretary  concurred  and  stated  that 
Army’s  ATD  management  plans  serve  as  formal  MOAs/MOUs  and  as  TTAs. 

Audit  Response.  Although  management  comments  concurred,  the  comments 
were  not  fully  responsive  to  the  recommendation.  The  comments  excluded 
applicability  to  STOs.  Therefore,  we  request  the  Assistant  Secretary  of  the 
Army  for  Acquisition,  Logistics,  and  Technology  to  provide  comments  to  the 
final  report  that  address  applicability  to  STOs. 

4.  Require  the  participation  of  the  program  executive  officer  and  the 
acquisition  program  manager  in  the  Army  science  and  technology  annual 
review  process.  The  program  executive  officer  and  acquisition  program 
manager  should  review  and  formally  comment  on  the  feasibility  of  science 
and  technology  projects  that  are  integrating  and  transitioning  into 
acquisition  programs. 

Management  Comments.  The  Assistant  Secretary  concurred  and  stated  that 
action  is  underway  to  include  the  program  executive  officer  in  the  Army  Science 
and  Technology  Working  Group  Aat  approves  all  STOs  and  ATDs. 

Audit  Response.  Management  comments  were  responsive  to  the 
recommendation . 

5.  Review  the  technology  paths  or  plans  for  the  18  science  and 
technology  projects  identified  in  this  audit  and  discontinue  any  project  that 
does  not  have  formal  acquisition  program  support. 

Management  Comments.  The  Assistant  Secretary  nonconcurred  and  stated 
that  S&T  examines  the  feasibility  of  technology  to  solve  warfighter  problems, 
and  that  only  the  most  technically  mature  efforts  in  the  advanced  technology 
development  program  should  be  considered  and  planned  for  transitioning.  The 
General  Accounting  Office  criticized  the  Services  for  attempting  transitions 
when  technology  was  immature. 

The  Assistant  Secretary  stated  that  the  nature  of  S&T  in  relation  to  acquisition 
has  three  phases;  basic,  applied,  and  advanced  technology  development.  Basic 
research  is  discovery  and  understanding,  trying  to  expand  the  knowledge.  Basic 
research  does  not  directly  transition  to  acquisition.  Applied  research  can  be 
repeated,  shows  military  utility,  and  can  be  further  evaluated  in  the  most  mature 
technology  environment-  advanced  technology  development.  Advanced 
technology  development  has  the  highest  probability  of  providing  transitionable 
products.  Within  advanced  technology  development,  the  Army  has  three  broad 
categories  of  activity;  ATDs,  STOs,  and  other  advanced  technology  efforts 
(referred  to  by  the  Army  as  non-STOs).  ATDs  are  the  most  complex  efforts 
and  have  the  closest  link  to  acquisition  programs.  STOs  are  typically  less 
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complex  and  their  ability  to  transition  is  based  upon  Army  funding  priorities  and 
warfighting  requirements.  Whether  STOs  transition  or  not,  they  remain 
valuable  “proof”  of  teehnology  eoneepts  and  eapabilities.  The  remaining 
advaneed  teehnology  efforts  (non-STOs)  are  used  to  pursue  higher  risk 
teehnology  and  have  a  lower  probability  of  transitioning. 

Audit  Response.  Management  eomments  were  nonresponsive  and  do  not 
address  the  intent  of  the  reeommendation.  We  understand  the  distinetion 
between  basie  and  applied  researeh  and  we  did  not  inelude  S&T  efforts  in  those 
early  stages  in  this  audit.  We  agree  that  immature  teehnology  should  not 
transition  and  believe  that  strengthening  eoordination  between  the  S&T  and 
aequisition  eommunity,  ineluding  formally  agreeing  to  TRLs  and  exit  eriteria, 
would  signifieantly  reduee  problems  in  this  area. 

The  report  of  the  Under  Seeretary  of  Defense  for  Aequisition,  Teehnology,  and 
Logisties  to  Congress,  in  June  2001,  eited  a  key  reason  for  diffieult  teehnology 
transitions  was  the  need  for  eollaboration  among  three  diverse  groups:  the  S&T 
researeher,  the  aequisition  program  manager,  and  the  military  user.  The  Under 
Seeretary ’s  report  stated  that  effeetive  transitions  require  the  groups  to  work 
together  as  a  team,  whieh  is  frequently  a  diffieult  issue.  Management  eomments 
ignore  the  results  of  this  review  summarized  in  “Summary  of  Seienee  and 
Teehnology  Objeetives  (STOs)  and  Advaneed  Teehnology  Demonstrations 
(ATDs)  Examined,”  (page  8)  that  improvements  are  needed  for  two  members  of 
this  diverse  group. 

The  Army  requires  advaneed  teehnology  development  efforts,  ATDs,  and  STOs 
to  identify  transitioning  plans  or  paths  as  deseribed  in  the  Army  Seienee  and 
Teehnology  Review  Proeess  (page  4).  The  proeess  requires  teehnology  projeet 
doeumentation  ineluding  the  Ten-Question  Quad  Chart  that  identifies  the 
planned  aequisition  program  for  the  emerging  teehnology.  This  audit  examined 
the  eoordination  efforts  from  Army’s  Ten-Question  Quad  Chart  between  the 
S&T  eommunity  and  the  identified  aequisition  program  offiees.  With  limited 
S&T  finaneial  resourees,  it  would  be  prudent  for  management  to  align  S&T 
efforts  in  areas  that  are  more  likely  to  result  in  a  sueeessful  transitioning  of  the 
teehnology  to  the  warfighter.  The  intent  of  the  reeommendation,  based  on  the 
laek  of  eoordination  among  two  of  the  diverse  groups,  was  to  examine  those 
efforts  that  do  not  have  adequate  eoordination  as  reeommended  in  the 
Handbook,  the  Guide,  and  Defense  Systems  Management  College  training.  We 
believe  that  eontinued  expenditure  of  advaneed  teehnology  demonstration  funds 
without  the  proper  eoordination  for  teehnology  efforts  is  inappropriate  and 
ignores  lessons  learned.  Therefore,  we  request  that  the  Assistant  Seeretary  of 
the  Army  for  Aequisition,  Logisties,  and  Teehnology  reeonsider  his  position  and 
provide  additional  eomments  to  the  final  report. 
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B.  Performance  Assessments 


The  performance  appraisal  process  was  not  effectively  used  as  a 
management  tool  to  assist  in  achieving  DoD  performance  goals  and  the 
Army  Materiel  Command’s  corporate  objective  of  transitioning 
technology  quickly  to  the  warfighter.  This  condition  exists  because  the 
Centers  did  not  incorporate  performance  goals  necessary  for  successful 
technology  transitioning  into  the  S&T  project  managers’  performance 
plans.  As  a  result,  the  Army  Materiel  Command’s  Research, 
Development  and  Engineering  Centers  (Centers)  were  not  fully  applying 
the  Deputy  Under  Secretary  of  Defense  (Science  and  Technology)  best 
practices  and  Army  guidance  on  managing  and  coordinating  the 
transition  of  technology. 

Background 


Deputy  Under  Secretary  of  Defense  (Science  and  Technology).  The  Deputy 
Under  Secretary  of  Defense  (Science  and  Technology)  issued  a  Handbook 
followed  by  a  Guide  to  the  Military  Departments  and  Defense  agencies 
concerning  practices  that  he  believes,  if  instituted,  would  assist  in  achieving  the 
DoD  goal  for  transitioning  technology. 

Addressing  Affordability  in  Defense  Science  and  Technology  (S&T): 
A  Handbook  for  S&T  Managers.  In  October  1999,  the  DoD  S&T 
Affordability  Task  Force  issued  a  Handbook  that  stressed  the  importance  of 
involving  all  candidate  acquisition  programs;  that  is,  the  acquisition  program 
managers,  in  developing  research.  The  Handbook  emphasized  that  effective 
transitioning  of  technology  should  include  establishing  IPT  groups,  creating  an 
IPT  charter,  identifying  and  agreeing  to  quantitative  metrics  and  key  exit 
criteria,  developing  formal  transition  plans,  and  developing  memorandums  of 
agreement  or  understanding.  The  Handbook  stressed  that,  through  the 
establishment  of  working  groups  and  agreements  with  all  candidate  acquisition 
programs  such  as  the  receiving  program  office  and  the  user,  evolving 
technology  has  a  better  chance  of  transitioning. 

The  Handbook  also  stated  that  one  of  the  keys  to  successful  transitioning  is 
implementing  an  S&T  personnel  assessment  process  that  is  based  on 
transitioning  and  affordability,  in  addition  to  technical  personal  achievement  and 
papers. 


Technology  Transition  for  Affordability:  A  Guide  for  S&T  Program 
Managers.  In  April  of  2001,  the  Deputy  Under  Secretary  of  Defense  (Science 
&  Technology)  issued  a  Guide  to  provide  S&T  project  managers  with  strategies 
for  achieving  technology  transitioning.  The  Guide  emphasized  the  importance 
of  teaming  with  the  customer;  that  is,  the  acquisition  program  manager.  The 
Guide  stated  that,  although  S&T  projects  are  viewed  as  pre-acquisition,  S&T 
inclusion  in  the  new  acquisition  policy  (DoD  Instruction  5000  and 
DoD  5000. 2-R)  should  serve  to  focus  resources  on  improving  transitioning. 

The  implementation  of  the  new  acquisition  policy  that  includes  S&T  in  the 


18 


acquisition  process  will  yield  inereased  eonneetivity,  visibility,  and 
eommunieation  among  the  S&T  eommunity,  the  aequisition  eommunity,  and  the 
user,  all  of  whieh  are  important  for  effeetive  transitioning. 

Army  Materiel  Command’s  Strategic  Plan.  The  Army  Materiel  Command 
(AMC)  issued  its  strategie  plan  in  July  2001.  The  AMC  Strategie  Plan 
identifies  eight  strategie  goals  as  instrumental  to  the  AMC  and  the  Army’s 
sueeessful  transformation  outlined  in  the  Army  vision.  To  aeeomplish  the 
8  strategie  goals,  the  AMC  promulgated  14  objeetives.  Three  of  the  AMC 
objeetives  inelude  developing  and  implementing  an  AMC  eorporate  S&T 
eapability  to  integrate  all  organizations  and  diseiplines  in  support  of  the  Army 
transformation;  developing  and  implementing  proeesses  to  rapidly  aequire  and 
field  the  best  teehnology  to  transform  the  foree  and  enhanee  survivability, 
lethality,  deployability  and  affordability;  and  developing  and  implementing  a 
proeess  to  transition  teehnology  to  materiel  developers  (aequisition  program 
managers)  in  a  timely  manner.  The  AMC  Strategie  Plan  provides  a  framework 
to  build  the  AMC  of  the  future  and  stresses  that  its  sueeess  requires  a  total 
eommitment  from  every  leader,  manager,  and  assoeiate.  The  AMC  Strategie 
Plan  also  requires  eaeh  AMC  element  to  develop  a  eorresponding  plan  with 
goals,  objeetives,  and  metries  that  are  elosely  aligned  to  the  framework  of  the 
AMC  Strategie  Plan. 

Project  Manager  Performance  Plans 


Major  Subordinate  Commands  and  Personal  Performance  Objectives.  On 

September  12,  2001,  the  Commander,  AMC,  issued  a  memorandum  reiterating 
that  major  subordinate  eommands  are  required  to  prepare  their  Strategie  Plans 
and  Command  Objeetives  in  eonsonanee  with  the  AMC  Strategie  Plan.  The 
AMC  memorandum  also  required  that  major  subordinate  eommands  link  every 
senior  leader’s  performanee  plan,  down  to  the  division  level,  to  the  objeetives  of 
the  major  subordinate  eommands. 

The  personal  performanee  plans  obtained  for  S&T  projeet  managers  at  the 
Armament  Researeh,  Development,  and  Engineering  Center  of  die  Army  Tank- 
automotive  and  Armament  Command;  and  the  Aviation  Applied  Teehnology 
Direetorate  of  the  Army  Aviation  and  Missile  Command,  did  not  inelude 
adequate  S&T  performanee  requirements  neeessary  to  enhanee  teehnology 
transitioning. 

Armament  Research,  Development  and  Engineering  Center.  Examination  of 
performance  plans  for  S&T  project  managers  identified  that  the  managers  are 
responsible  for  technical  program  management,  engineering  design  and  support, 
financial  management,  and  training  and  security. 

Technical  program  management  responsibilities  include  planning,  scheduling, 
and  coordinating  all  major  activities  related  to  the  S&T  project;  conducting 
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briefings  on  S&T  tasks;  attending  and  partieipating  in  meetings  and  eonferenees; 
overseeing  test  plan  preparation;  eoordinating  and  witnessing  tests;  and 
eondueting  speeial  projeets  or  tasks  involving  planning,  eontrol,  analysis,  and 
exeeution. 

Engineering  design  and  support  responsibilities  inelude  providing  engineering 
support;  providing  guidanee  on  follow-on  design  efforts;  and  preparing 
requirements  to  software  eontraetors. 

Finaneial  management  responsibilities  inelude  developing  funding  requirements 
and  expenditure  plans;  reviewing  funding  performanee;  and  maintaining 
expenditures  within  finaneial  guidelines. 

Training  and  seeurity  foeused  on  obtaining  training  and  being  aware  of  and 
eomplying  with  seeurity  proeedures. 

None  of  the  plans  diseussed  performanee  requirements  in  relation  to 
transitioning  S&T  projeets  to  aequisition  programs.  The  ineorporation  of  this 
performanee  element  in  S&T  projeet  managers’  performanee  appraisals  would 
emphasize  the  importanee  of  transitioning  teehnology. 

Aviation  Applied  Technology  Directorate.  The  review  of  S&T  projeet 
managers’  performanee  plans  at  the  Aviation  Applied  Teehnology  Direetorate 
showed  that  the  teehnieal  personnel  were  responsible  for  projeet  planning, 
projeet  exeeution,  professional  development,  and  team  leadership. 

Projeet  planning  funetions  inelude  planning  realistie  and  exeeutable  sehedules 
within  budget  eonstraints;  identifying  mission  needs  and  defieieneies; 
eoordinating  efforts  vertieally  and  horizontally  with  other  organizations; 
developing  projeet  plans,  ineluding  need,  teehnology  feasibility,  eost  estimates; 
developing,  evaluating,  and  negotiating  eontraet  work  efforts,  engineering 
speeifieations;  and  developing  eontraet  data  requirements. 

Projeet  exeeution  responsibilities  inelude  maintaining  eognizanee  and 
responsibility  for  exeeution  of  assigned  S&T  projeets  so  that  teehnieal  eost  and 
sehedules  are  quantifiable  and  eommensurate  with  projeet  plans;  identifying 
projeet  perturbations  and  taking  timely  eorreetive  aetions;  ensuring  proper 
expenditure  of  funds;  and  satisfying  eustomers  (internal  and  external). 

Professional  development  and  team  leadership  inelude  maintaining  teehnieal 
eompetenee  and  eultivating  professional  and  personal  growth  of  team  personnel. 

The  inelusion  of  projeet  planning,  projeet  exeeution,  professional  development, 
and  team  leadership  are  all  important  performanee  elements  for  the  S&T  projeet 
managers.  The  inelusion  of  a  performanee  element  eoneerning  teehnology 
transition  would  help  highlight  that  proven  teehnology  must  transition  to  the 
warfighter. 

Performance  Assessments.  Although  the  S&T  projeet  managers’  performanee 
attributes  identified  at  the  Center  and  the  Direetorate  are  valuable  in  exeeuting 
S&T  projeets,  the  S&T  projeet  managers  are  not  required  to  establish  and 
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maintain  the  necessary  attributes  for  coordination  and  technology  transitioning 
identified  in  the  Deputy  Under  Secretary  of  Defense  (Science  and  Technology) 
Handbook  and  Guide. 

As  identified,  S&T  project  managers  were  not  held  accountable  for  establishing 
a  process  to  enhance  technology  transitioning.  The  inclusion  of  the  requirement 
in  S&T  project  managers’  performance  plans  to  establish  and  maintain  formal 
coordination  with  all  candidate  acquisition  programs  through  establishing  IPT 
groups,  creating  IPT  charters,  formalizing  and  maintaining  up-to-date 
agreements  with  all  candidate  acquisition  programs  of  quantitative  metrics  and 
key  exit  criteria,  establishing  formal  transition  plans,  and  developing 
memorandums  of  agreement  or  understanding  would  significantly  assist 
technology  transitioning. 

The  inclusion  of  those  requirements  would  hold  S&T  project  managers 
accountable  for  establishing  a  process  to  enhance  transition  and  serve  as  a  basis 
for  assessing  performance  as  required  by  Army  Pamphlet  70-3.  In  addition,  the 
performance  assessment  process  would  be  a  management  tool  at  the  S&T  project 
manager  level  (as  opposed  to  only  at  the  division  level)  to  assist  in  achieving  the 
AMC  Strategic  Plan  and  the  requirement  of  the  AMC  memorandum  of 
September  12,  2001,  by  providing  a  link  between  performance  assessments  and 
technology  transitioning. 

Conclusion 


The  Department  of  the  Army  Pamphlet  70-3,  “Army  Acquisition  Procedures,” 
July  15,  1999,  provides  discretionary  guidance  on  materiel  acquisition 
management.  The  Pamphlet  is  relevant  to  research,  development,  and 
acquisition  efforts.  The  Pamphlet  defines  technology  transition  after  a  validated 
need  is  approved  and  after  the  technologies  critical  to  performance  have  been 
proved.  The  Pamphlet  states  that  technology  transitioning  requires  early 
coordination  among  the  S&T  project  manager,  the  acquisition  program 
manager,  and  the  user.  The  Pamphlet  provides  that,  prior  to  transitioning,  the 
technology  must  be  demonstrated,  tested,  and  shown  to  be  predictable;  that 
there  must  be  a  clear  military  need  for  the  capability;  and  that  the  technology 
introduction  must  be  cost-effective.  The  Pamphlet  states  that  an  S&T  project 
manager  will  be  assigned  to  each  technology  project  and  that  the  timely 
accomplishment  of  the  technology  should  be  a  basis  for  assessing  the 
performance  of  the  S&T  project  manager.  Examination  of  S&T  project 
managers  performance  plans  showed  that  they  do  not  adequately  satisfy  the 
intent  of  Army  Pamphlet  70-3,  and  performance  plans  should  explicitly  require 
actions  related  to  technology  transitioning  as  a  performance  element. 
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Recommendation,  Management  Comments,  and 
Audit  Response 


B.  We  recommend  that  the  Commander,  Army  Materiel  Command  require 
that  the  personnel  performance  plans  for  managers  responsible  for 
advanced  technology  development-funded  programs  at  its  Research, 
Development  and  Engineering  Centers  explicitly  require  an  assessment  of 
managers’  performance  with  planned  technology  users.  The  performance 
plans  should  include  performance  assessments  for  the  establishment  of 
integrated  product  teams  with  all  planned  technology  users,  creation  of 
integrated  product  team  charters,  coordination  and  acceptance  of 
quantitative  metrics  and  key  exit  criteria  with  all  planned  users, 
development  of  transition  plans  that  are  formally  agreed  to  by  all  planned 
users,  and  the  development  and  maintenance  of  up-to-date  memorandums 
of  agreement  or  understanding  with  all  planned  users. 

Management  Comments.  The  Commander,  Army  Materiel  Command  did  not 
provide  eomments  to  the  draft  report;  however,  the  Assistant  Seeretary 
eoneurred  with  eomment.  The  Assistant  Seeretary  stated  that  the  Department  of 
the  Army  eoneurs  with  the  philosophy  of  linking  personnel  performanee  to 
program  performanee.  However,  only  the  ATD  managers  should  be  held 
aeeountable  for  transition  sinee  the  predominanee  of  S&T  is  trying  to 
demonstrate  what  is  possible,  and  STO  teehnology  is  too  immature  for 
transition.  The  Assistant  Seeretary  stated  that  the  Commander,  Army  Materiel 
Command  is  reviewing  the  reeommended  approaeh  to  require  an  assessment  for 
ATD  managers  with  other  performanee  me  tries,  sueh  as  aehieving  TRLs. 

Audit  Response.  We  eonsidered  the  Assistant  Seeretary’s  eomments  in 
preparing  the  final  report.  We  elarified  the  reeommendation  to  address  the  need 
to  inelude  teehnology  transitioning  in  performanee  plans  for  managers  who  are 
responsible  for  advaneed  teehnology  development  programs  as  opposed  to  basie 
and  applied  teehnologies. 

The  Assistant  Seeretary’s  eomments  were  partially  responsive.  We  believe  that 
the  poliey  of  linking  personnel  performanee  to  program  performanee  should 
apply  to  STO  managers  as  well  as  ATD  managers.  We  see  no  distinetion 
between  ATD  and  Ae  STO  managers’  responsibility  in  that  the  programs  being 
managed  are  supported  with  advaneed  teehnology  development  funds.  Linking 
teehnology  transitioning  to  S&T  managers’  performanee  would  assist  in 
establishing  a  tone  that  the  DoD  is  serious  about  enhaneing  the  likelihood  of 
providing  advaneed  teehnologies  to  the  warfighter.  We  request  that  the 
Commander,  Army  Materiel  Command  provide  comments  to  this 
recommendation  in  the  final  report. 
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Appendix  A.  Scope  and  Methodology 


Scope 


We  examined  20  S&T  projeets  at  the  Army  Tank-automotive  and  Armament 
Command,  Armament  Researeh,  Development  and  Engineering  Center  and  the 
Army  Aviation  and  Missile  Command,  Aviation  Applied  Teehnology 
Direetorate  to  evaluate  the  management  proeess  for  transitioning  sueeessful 
teehnologies  to  the  warfighter.  The  S&T  projeets  examined  at  the  two  Army 
sites  visited  were  funded  with  researeh,  development,  test,  and  evaluation 
appropriations  for  advaneed  teehnology  development  and  had  expenditures  of 
$441.5  million  and  planned  additional  funding  of  $244.4  million. 

We  did  not  evaluate  the  teehnieal  merits  of  the  S&T  projeets.  We  did  not 
review  the  management  eontrol  programs  at  the  Army  Tank-automotive  and 
Armament  Command,  Armament  Researeh,  Development  and  Engineering 
Center  or  the  Army  Aviation  and  Missile  Command,  Aviation  Applied 
Teehnology  Direetorate.  We  limited  our  management  eontrol  review  to  the 
management  proeedures  of  transitioning  teehnology  from  S&T  projeets  to  the 
aequisition  program  managers. 

General  Accounting  Office  High-Risk  Area.  The  General  Aeeounting  Offiee 
has  identified  several  high-risk  areas  in  the  DoD.  This  report  provides  eoverage 
of  the  Weapon  System  Aequisition  (DoD  WEP  SYS  ACQ)  high-risk  area. 

Methodology 


We  eondueted  interviews  with  S&T  and  aequisition  program  offieials,  and 
examined  applieable  key  doeumentation.  Key  doeumentation  reviewed  ineluded 
guidanee  advoeated  by  the  Deputy  Under  Seeretary  of  Defense  (Seienee  and 
Teehnology);  the  Army  Seienee  and  Teehnology  Master  Plan  for  2001;  the 
Ten-Question  Quad  Chart;  integrated  produet  team  eharters  and  meeting 
minutes;  memorandums  of  understanding  or  agreement;  aequisition  program 
funding  profiles;  S&T  management  plans;  teehnology  transition  paths  or  plans; 
the  AMC  Strategie  Plan;  the  researeh,  development,  test,  and  evaluation  budget 
item  justifieation  sheet  (R-2  Exhibit);  and  performanee  plans  for  S&T  projeet 
managers.  We  reviewed  key  doeumentation  dated  from  April  1993  through 
Oetober  2001.  We  also  eondueted  interviews  with  S&T  management  offieials  at 
the  Offiee  of  the  Seeretary  of  Defense  and  the  Army. 

We  relied  on  eomputer-proeessed  data  without  performing  tests  of  general  and 
applieation  system  eontrols  to  eonfirm  the  reliability  of  the  database.  We 
obtained  a  eomputerized  listing  of  Army  researeh,  development,  test,  and 
evaluation  appropriations  for  advaneed  teehnology  development  from  the  Offiee 
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of  the  Deputy  Assistant  Seeretary  of  the  Army  for  Researeh  and  Teehnology. 
We  relied  on  the  eomputerized  listing  to  represent  the  known  universe  of  S&T 
projeets  in  our  review  of  the  management  proeess.  We  validated  the  total 
funding  on  the  eomputerized  listing  to  the  total  funding  of  the  Army  researeh, 
development,  test,  and  evaluation  appropriations  for  advaneed  teehnology 
development.  The  S&T  projeets  reviewed  at  the  two  sites  visited  were  aetive 
S&T  projeets  and  eorrelated  to  the  data  in  the  eomputerized  listing.  Validating 
the  eomputerized  listing  to  the  appropriations  was  deemed  appropriate  for  this 
audit  beeause  the  audit’s  objeetive  was  to  examine  the  management  proeess  for 
transitioning  teehnology,  not  the  individual  S&T  projeets,  and  further  validation 
of  the  eomputerized  listing  would  not  ehange  the  eonelusions  in  this  report. 

Audit  Dates  and  Standards.  We  performed  this  program  results  audit  from 
April  2001  through  January  2002  in  aeeordanee  with  generally  aeeepted 
government  auditing  standards. 

Contacts  During  the  Audit.  We  visited  or  eontaeted  individuals  and  organiza¬ 
tions  within  DoD.  Further  details  are  available  on  request. 

Management  Control  Program  Review 


DoD  Direetive  5010.38  “Management  Control  (MC)  Program,”  August  26, 
1996,  and  DoD  Instruetion  5010.40,  “Management  Control  (MC)  Program 
Proeedures,”  August  28,  1996,  require  DoD  organizations  to  implement  a 
eomprehensive  system  of  management  eontrols  that  provides  reasonable 
assuranee  that  programs  are  operating  as  intended  and  evaluate  the  adequaey  of 
the  eontrols. 

Scope  of  the  Review  of  the  Management  Control  Program.  We  evaluated  the 
management  eontrol  proeess  to  determine  whether  effeetive  management 
proeedures  were  established  to  transition  sueeessful  S&T  projeets  to  aequisition 
program  managers  and,  ultimately,  to  the  warfighter. 

Adequacy  of  Management  Controls.  The  audit  identified  that  the  Army 
leadership  ereated  a  eomprehensive  high-level  management  oversight  proeess  to 
approve  and  review  proposed  and  ongoing  teehnologies.  However,  the  Army 
S&T  oversight  proeess  does  not  require  the  involvement  of  program  exeeutive 
offieers  or  individual  aequisition  program  managers.  The  Army  S&T  oversight 
proeess  also  does  not  require  the  establishment  of  formal  eoordination 
doeuments  with  aequisition  offieials  as  a  eondition  for  approval  of  eontinued 
funding.  The  absenee  of  aequisition  offieials  and  formal  eoordination 
doeuments  in  the  oversight  proeess  is  eonsidered  a  material  management  eontrol 
weakness,  as  diseussed  in  the  Finding  seetion  of  this  report.  The 
reeommendations  for  both  findings,  if  implemented,  will  improve  the 
transitioning  of  teehnology  to  the  aequisition  program  manager  and  to  the 
warfighter.  A  eopy  of  the  report  will  be  provided  to  the  senior  Army  offieial 
responsible  for  management  eontrols. 


24 


Prior  Coverage 


During  the  last  5  years,  the  General  Aeeounting  Offiee  issued  two  reports 
diseussing  the  benefits  of  adequately  managing  the  ehallenges  of  transitioning 
teehnologies  to  warfighters. 

General  Accounting  Office 

Report  No.  GAO-1-311,  Defense  Aequisition:  Army  Transformation  Faees 
Weapon  Systems  Challenges,  May  21,  2001 

Report  No.  NSIAD-99-162,  Best  Praetiees:  Better  Management  of  Teehnology 
Development  Can  Improve  System  Outeomes,  July  30,  1999 
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Appendix  B.  Technology  Readiness  Levels  and 

Their  Definitions 


The  following  matrix  lists  the  various  teehnology  readiness  levels  and  provides  a 
deseription  of  eaeh  as  listed  in  Appendix  6  of  DoD  5000. 2-R,  “Mandatory  Proeedures 
for  Major  Defense  Aequisition  Programs  (MDAPS)  and  Major  Automated  information 
System  (MAIS)  Aequisition  Programs,”  10  June  2001. 


Technology  Readiness  Level 

Description 

1 .  Basic  principles  observed  and 
reported. 

Lowest  level  of  technology  readiness.  Scientific  research  begins  to 
be  translated  into  technology’s  basic  properties. 

2.  Technology  concept  and/or 
application  formulated. 

Invention  begins.  Once  basic  principles  are  observed,  practical 
applications  can  be  invented.  The  application  is  speculative  and 
there  is  no  proof  or  detailed  analysis  to  support  the  assumption. 
Examples  are  still  limited  to  paper  studies. 

3.  Analytical  and  experimental 
critical  function  and/or  characteristic 
proof  of  concept. 

Active  research  and  development  is  initiated.  This  includes 
analytical  studies  and  laboratory  studies  to  physically  validate 
analytical  predictions  of  separate  elements  of  the  technology. 
Examples  include  components  that  are  not  yet  integrated  or 
representative. 

4.  Component  and/or  breadboard 
validation  in  laboratory 
environment. 

Basic  technological  components  are  integrated  to  establish  that  the 
pieces  will  work  together.  This  is  relatively  “low  fidelity”  compared 
to  the  eventual  system.  Examples  include  integration  of  “ad  hoc” 
hardware  in  a  laboratory. 

5.  Component  and/or  breadboard 
validation  in  relevant  environment. 

Fidelity  of  breadboard  technology  increases  significantly.  The  basic 
technological  components  are  integrated  with  reasonably  realistic 
supporting  elements  so  that  the  technology  can  be  tested  in 
simulated  environment.  Examples  include  “high  fidelity”  laboratory 
integration  of  components. 

6.  Sy stem/ subsystem  model  or 
prototype  demonstration  in  a 
relevant  environment. 

Representative  model  or  prototype  system,  which  is  well  beyond 
the  breadboard  tested  for  level  5,  is  tested  in  a  relevant 
environment.  Represents  a  major  step  up  in  a  technology’s 
demonstrated  readiness.  Examples  include  testing  a  prototype  in  a 
high  fidelity  laboratory  environment  or  in  a  simulated  operational 
environment. 

7.  System  prototype  demonstration 
in  an  operational  environment. 

Prototype  near  or  at  planned  operational  system.  Represents  a  major 
step  up  from  level  6,  requiring  the  demonstration  of  an  actual 
system  prototype  in  an  operational  environment.  Examples  include 
testing  the  prototype  in  a  test  bed  aircraft. 

8.  Actual  system  completed  and 
qualified  through  test  and 
demonstration. 

Technology  has  been  proven  to  work  in  its  final  form  and  under 
expected  conditions.  In  almost  all  cases,  this  level  represents  the 
end  of  true  system  development.  Examples  include  developmental 
test  and  evaluation  of  the  system  in  its  intended  weapon  system  to 
determine  whether  it  meets  design  specifications. 

9.  Actual  system  proven  through 
successful  mission  operations. 

Actual  application  of  the  technology  in  its  final  form  and  under 
mission  conditions,  such  as  those  encountered  in  operational  test 
and  evaluation.  Examples  include  using  the  system  under 
operational  mission  conditions. 
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Appendix  C.  Army  Science  and  Technology 

Approval  Process 
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Science  and  Technology  Objectives 


Appendix  D.  Summary  of  Advanced  Technology 

Development  Projects  Reviewed 
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Note:  See  footnotes  at  the  end  of  the  appendix. 


Fundmg  Receiving 

IPT^  By  Receiving  User 

Established  IPT^  Includes  Acquisition  User  Agreed  to 

MOA/MOU'  an  IPX*  Includes  Prime  User  to  Agreed  to  Exit  Exit 
System  Receiving  User  With  User  IPT^  Charter  User  Contractor  Transition  Level  TRL  Criteria 
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Note:  See  footnotes  at  the  end  of  the  appendix. 
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Advanced  Technology  Demonstrations 


32 


Note:  See  footnotes  at  the  end  of  the  appendix. 
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Appendix  E.  Report  Distribution 


Office  of  the  Secretary  of  Defense 

Under  Secretary  of  Defense  for  Acquisition,  Technology,  and  Logistics 
Deputy  Under  Secretary  of  Defense  for  Science  and  Technology 
Under  Secretary  of  Defense  (Comptroller/ Chief  Financial  Officer) 

Deputy  Chief  Financial  Officer 
Deputy  Comptroller  (Program/Budget) 

Department  of  the  Army 

Assistant  Secretary  of  the  Army  for  Acquisition,  Logistics,  and  Technology 
Assistant  Secretary  of  the  Army  (Financial  Management  and  Comptroller) 

Commander,  Training  and  Doctrine  Command 
Deputy  Chief  of  Staff  for  Programs 
Commander,  Army  Materiel  Command 

Commander,  Tank-automotive  and  Armaments  Command 
Armament  Research  and  Development  Engineering  Center 
Commander,  Aviation  and  Missile  Command 

Director,  Aviation  Applied  Technology  Directorate 
Project  Executive  Officer  for  Aviation 

Project  Executive  Officer  for  Ground  Combat  and  Support  Systems 
Auditor  General,  Department  of  the  Army 

Non-Defense  Federal  Organization 

Office  of  Management  and  Budget 

Congressional  Committees  and  Subcommittees,  Chairman  and 
Ranking  Minority  Member 

Senate  Committee  on  Appropriations 

Senate  Subcommittee  on  Defense,  Committee  on  Appropriations 
Senate  Committee  on  Armed  Services 
Senate  Committee  on  Governmental  Affairs 
House  Committee  on  Appropriations 

House  Subcommittee  on  Defense,  Committee  on  Appropriations 
House  Committee  on  Armed  Services 
House  Committee  on  Government  Reform 

House  Subcommittee  on  Government  Efficiency,  Financial  Management,  and 
Intergovernmental  Relations,  Committee  on  Government  Reform 
House  Subcommittee  on  National  Security,  Veterans  Affairs,  and  International 
Relations,  Committee  on  Government  Reform 
House  Subcommittee  on  Technology  and  Procurement  Policy,  Committee  on 
Government  Reform 
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Department  of  the  Army  Comments 


DEPARTMENT  OF  T>£  AFiMY 

OFFKX  OF  THE  ASSISTANT  SECRElWn’ OF 'THE  ARMT 
ACCXJISTKIN  LOGISTICS  AND  TECWtOLDGY 
103  ARMY  FSIMOON 
WASHHGFON  DC  SCBIIMniB 

■OT-rn 

AnaimflF 

*3  fw  m 


SAAL-ZT 


MEMORANDUM  FOR  OFHCE  OF  THE  fNSPECTOR  GENERAL,  DOD 

SUBJECT:  Audil  AB^I  05  (Project  No.  D2001-AB^)1 05)  Tramsilion  of  Advanced 
Technology  Programs  to  Militaty  Apfriications 


The  Aimy  appredafes  the  oppolunity  to  (XDvide  comments  on  the  Department 
of  Defense  Inspsctor  GeneiaTs  (IG's)  i^iort  on  the  transition  of  advanced  technology 
programs  to  military  applications.  The  Army  uses  Army  Reguiation  70-1  (Re^arch, 
DeveloliMnent  and  Acquisition,  Army  Acquisition  and  Policy)  and  the  Anhy  Pamphlet 
TIM  (Research,  Development  and  Acquisition,  Army  Acquisition  Procedures)  to 
estabfish  sdence  and  technology  program  managernent  procedures.  ThesepoHcies 
and  procechires  are  cor^istent  OSD  poTicy  and  guktimce. 

RecommendaUons; 

A(1).  Require  the  estdaHdrment  of  integrated  |MOChjcttean»(IPTs)  that  indude 
representatives  from  the  candidate  acquisition  program  office(s)  andtheaoqusaion 
prime  contractors(s),  where  appropriate. 

Concur.  The  Arn^  already  requires  the  ctesdion  of  iPTs  that  involve  bc^  the 
acquisition  and  sdence  and  technology  program  managers  for  all  Advanced 
Technology  Demonstration  (ATD)  programs  (16  in  FY02).  It  is  neither  appropriate 
nor  practical  for  eadr  Science  and  Technology  Objective  (STO)  (1 55  in  FYQ2)  to 
haveanIPT.  STO  programs  are  rrf  lesser  maturity  than  ATDs  and  even  «^n 
successful,  require  further  develo(Hn«tt  before  the  creation  of  an  IPT  and  trtm^ion 
to  acqtiteHion  would  be  approprisde. 

A(2).  Require  the  estabRshment  of  formal  agreements  between  the  science  and 
technology  manage  and  the  candidate  acquisitidn  program  manager(s)  for 
emerging  tectvtotogies.  The  formal  agremtentsdwuidcoordnateffidt  criteria, 
technology  readiness  levels,  and  estimated  transitioning  timeiRTes. 

Concur.  ATD  management  plans,  which  are  aj^roved  by  the  Deputy  Assistant 
Secretary  for  Research  and  Technology  for  aB  ATDs,  document  program  mot  criteria. 
Technology  Reading  Levds  (TRLs)  and  estimated  technology  transition  time 
frames.  The  signed  ATD  management  plans  serve  as  MemcNanda  of  Agreemem 
(MOA)  or  Menxrranda  of  Understarxfing  (MOU)  between  the  science  arxl  tedinology 
managers  and  the  cffiTdidate  acquisifion  pro^am  manners. 

A(3).  Require  the  establishnwrt  of  formal  memorandums  of  agreement  or 
understan(&9  ffixf  tecfsK>IO(br  tem^on  agreements  between  the  soHice  and 
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techtx>logy  iTtanager  and  cancHKlaie  acquishiwi  program  managsr^s).  The 
establishment  of  the  formal  agreements  should  be  a  requirement  for  continued 
research,  development,  test  and  evaluation  funding. 

Concur. .  The  Army’s  ATD  maia^ment  plans  serve  as  fmnal  MOAs/MOUs  and  as 
Tedrnology  Transition  Agreements. 

A(4).  Require  the  partic^tion  of  the  program  executive  officer  and  tee  acquisition 
program  manager  te  the  Army  science  and  tecfmology  annual  review  process.  The 
program  executive  officer  and  acquisition  program  man^r  should  review  and. 
fonnaily  comment  on  the  fea^ility  of  science  and  technology  fxoiects  that  are 
integrating  and  transitioning  into  acquisition  programs. 

Concur.  Action  is  underway  this  year  to  indude  PEOs  in  the  Army  Scienra  and 
Technology  Working  Group  (ASTWG),  the  2-star  body  that  proves  al  STOs  and 
ATDs. 

A(5).  Review  tee  technology  pates  (X  plans  for  the  18  sdenoe  and  techndogy 
projects  identified  in  this  audit  and  discontimie  any  prefects  tiiat  does  not  have  fomtal 
acquisition  program  support. 

Nonconcur.  S&T  by  its  nature  examines  tiie  feasteility  of  technology  to  soim 
warfi^tier  problems  and  as  such  not  aB  ^orts  win  be  successful  to  have  established 
trandflonpattetoacquteifion.  Only  the  most  technically  mature  efforts  in  the 
advanced  technology  development  program  -  the  Advaix»d  Technology 
Demonstrations  -  should  be  considered  and  platmed  for  transition  to  acquisition. 
There  are  numerous  GAO  reports  that  ccmecUy  crftici^  the  Swvices  for  attempting 
transitions  when  technology  is  immature. 

One  needs  to  understand  that  tire  nature  and  role  of  scienoe  and  technology 
in  relation  to  acquisition.  Science  and  tecfmologyexamRies  potential  technologies  to 
fulfill  warfighter  needs,  which  may  or  may  nc4  haw  successful  paths  to  acquisition 
but  Htese  investments  produce  gains  thrmrgh  irrereased  technology  understanding. 
For  FY03  approodmately  1 5%  of  the  budget  requested  program  is  ^  Basic  Research. 
The  nature  of  this  wwk  is  (tiscoveiy  and  under^aming  -  to  expand  our 
knowledgebase.  Ba^researctedo^notditectiytransitkxitoaccpjisitkm. 
Knowler^  gained  here  can  resuH  in  understanding  of  science  to  develop  practical 
application  approaches.  As  these  approaches  become  feasirie  they  me  worked  in 
the  Applied  Research  Program,  which  encorr^tesses  another  40%  the  annual 
science  and  technology  budget  When  laboratory  appTications  of  apptied  research 
can  be  repeated  and  ^ow  military  utility  to  ourwsrfighting  customers,  it  can  be 
further  evaluated  In  the  most  mature  technology  environment,  tee  Advartced 
Technology  Deveiopmmt  Program.  Advanced  technotogydevek^Mnentfundtog 
provides  the  remaining  45%  of  the  anraiai  science  and  tectenology  budget  ttisteis 
investinent  in  advanced  technology  dev^opment  that  has  the  hi^iest  probabtty  of 
provkting  transitionafafe  ‘products.”  Wititin  these  efforts  there  are  tirree  tMoad 
categories  of  activity;  1)  advanced  technology  demonstr^ions.  2)  sd^rce  arxl 
tochnolo^  objectives  and  3)  other  advanced  technology  efforts.  The  ATDs  are  tee 
most  complex  and  rnature  ^T  efforts  with  the  dosesi  finkage  to  acquisition 
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programs.  ITidAnny  requires  that  ATD  managers  obtain  a  transition  mdorsenwnt 
from  ttw  appropriate  Title  10  Program  Manager  and  the  Army 
coordinates  programming  for  needed  bansition  funding  wiMn  resource  constraints. 
ATD  managers  are  already  held  accountable  to  achieve  thar  program’s  exit  criteria, 
which  indu^  transition  to  acquisttion.  The  STOs  are  typicaily  less  complex  S&T 
efforts,  and  their  ^Bty  to  transiSrxi  into  acquisition  is  based  upon  Army  funding 
(Niwiries  and  warfight^  reqwiements  that  would  require  fiekfing  of  th^ 
technologies.  Whether  transitioned  hto  PM  programs  or  not,  foese  efforts  remain 
vahKfole  as ‘pror^  of  techndogy  and  operatiotid  concepts  that  can  provide 
advanced  warfj^iting  capdsiliiies.  The  remafoing  advanced  technology  ^orts  are 
used  to  pursue  higher  ridr  tedmology.  These  terminologies  have  a  lower  probability 
of  success  than  ATD  or  STO  efforts  cmd  foerefore  should  not  be  programmed  for 
trandtiontoPMs.  However,  successhd  work  n  this  area  can  lead  to  future  ATD  or 
STO  programs  that  can  pro^  tfi  advance  to  technology  to  the  PM. 

B(1).  We  recominerid  that  foe  Commander,  Arriiy  Materiel  Cornrnand,  require  that 
foe  persrxinet  performance  plans  of  sdetxre  and  technology  profect  manors  at  its 
Reseanfo,  Development  and  Engineering  Centers  e)q>Scitly  require  an  assessment  of 
managers’ petfomtanoe  wifo  (farmed  technology  users.  Tlie  peifixmance  plans 
should  include  performance  cotxdination  assessments  for  the  establishmait  of 
integrated  (xoduct  teams  with  all  i^anned  technology  tsers,  creaQon  of  inte^ated 
product  team  charters,  coordination  and  acceptance  of  quantitative  metrics  and  key 
exit  criteria  wifo  all  planned  users,  development  of  a  formal  transition  ptems  that  are 
formally  agreed  to  by  all  planned  users,  and  foe  development  and  mafntenanoe  of 
up-to-date  m»norandums  of  ^eements  or  understanding  with  aB  piannsd  users. 
CoiKur  with  Comment  Headrpjarters  DA  concurs  wkh  foe  philosophy  of  linking 
personnel  performance  to  (xogram  performance.  However,  the  ATD  Program 
Managers  should  be  accountable  for  trarsBion  stece  foe  predorrmance  of  S&T  is 
trymg  to  demonstrate  the  art  of  foe  possfl^e  and  is  too  immature  for  transitjon  into 
acquisirion.  TheCommanderofthe  Army  Materiel  Crxnmand  is  reviewing  foe 
recommended  approach  to  require  an  assessment  of  ATD  program  managers’ 
performance  with  farmed  tedmiogy  users.  Other  perfonnarxre  metrics,  such  as 
progress  to  achieving  sdieduted  tadinoiogy  reacSness  levsis  as  spedfied  in  foe  GAO 
R^xxt  entUed, Man^ement  of  Technology  Development  Can  improve 
Weapon  Systems  Outcomes,' are  bdng  used  to  evaluate  S&T  personnel. 

General  Comments: 

The  role  of  the  Science  and  Technology  (S&T)  commuf%  within  foe  Army  is 
to  provide  both  a  near  term  capabiBfy  and  a  tor-term  focus  for  foe  future.  It  is  foe 
responsibility  of  the  S&T  community  to 'bring  technology  options  to  foe  tdite'.  Once 
foe  technology  has  shown  an  af^ropriate  level  of  maturity,  such  as  a  |»Dof-of- 
concept  demonstration,  S&T  Progrmn  Managers  (PMs)  negotiate  with  acquistfion 
Progrun  Managers  to  identify  aptxoptiate  transition  poittis.  When  the  acqtrisifion 
Progrren  Manager  detennines  that  a  technology  is  needed  to  satisfy  required 
capability  and  can  meet  foe  acquisition  program  schedule,  than  tiw  acquidlian 
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Program  Manager  «riR  se^  System  DeveiopiTiarit  and  Domonstralion 
transition  fundir^  (6.4). 

The  report  does  not  mention  or  address  the  primary  rde  of  alof  S&T  efforts. 
This  role  is  to  defiver  optiore  to  the  warfighter  so  that  they  can  choose  the  best 
approach  available  at  the  time  that  it  is  needed.  It  Is  criticaifoat  the  S&T  community 
be  allowed  to  do  esqiloration  prior  to  dscovery...  to  iod(  at  problstns  wHh  an  open 
SDlution  set,  rrice  a  pre-detemiined  path.  Theablitytoke^theopfionsopenforas 
long  as  pce^le  is  a  main  reason  for  not  rectuhring  a  6.4  funding  taR  for  all  of  the  S&T 
eSorts.  The  acquisition  commurRty  does  not  have  the  resources  to  pursue  an  of  the 
proposed  options  and  a  requirement  for  a  binding  tid  for  al  S&T  efforts  would  force  a 
down-8elec6onoftB(dmdogy1ooear1yinthedevekY)ment^cle.  TheArmyhas 
implemented  recommendabons  from  the  GAO  Report,  ‘Better  Management  of 
Te^rmlogy  Development  Can  Improve  Weapon  Systems  Outcomes,”  GAO/NSIAD- 
99-162,  dated  July  1999.  lnfoisrepott,ttreGAOtecogryzedlhatal^foctortothe 
successful  management  of  technology  was  to  make  the  S&T  organizMion,  rather 
than  the  program  or  product  dev^ofHnent  manager,  re^wnsfole  to  malur^ 
technr^ogy  to  a  high  Technology  Readiness  Level  (TRL),  hence  our  adoption  of 
TRLsasakeyiiKfrcator  of  maturity.  The  GAO  report  ato  prowies  a  go^ 
description  of  the  rde  of  S&T  to  general.  The  report  indcr^  BOD’ssciance  and 
technology  ccxnmunity  is  responside  tor  basic  reseruch,  applM  researdr,  and 
advanced  technology  development  to  produce  generic,  rattier  Sitei  weapons-spectfic, 
technoios^  Rs  god  is  to  conduct  research,  develop  technology,  and  term  these 
efforts  for  potential  trdftary^ication;  such  as  a  weapons  system...the  S&T  officials 
stated  role  is  to  show  that  tec^ology  te  feasbla  throng  iaboratoty  mcperiments  teid 
demonstration.*  It  is  understood  that  not  alt  S&T  programs  will  transttion  into  an 
Armysystem.  However,  transition  is  not  the  sole  purpose  of  the  Sanrice  S&T 
programs.  The  purpose  of  STOs  and  ATDs  are  to  focus  on  work  needed  by  ttw 
warti^iter.  The  S&T  community  win  ultimatefy  transition  the  technology  when  the 
Army  deddes  thte  it  needs  the  capabMtty  and  has  ftmds  for  its  acquisitioa 

Actions  Reported  Suisequent  to  the  Kj  Review: 

Advanced  Rotorcrafl  Trmsrttission  fARTI:  The  Torque  design  developed  under 
ART  I  has  transitioned  into  the  Comanche.  ART  H  technologies  are  being 
transitioned  into  the  ROS21  Tech  Demo. 

Airborne  MannedfUnmained  Systems  TectwoloQv  (AMUSTI:  AMUST  Technology 
along  with  Rotorcraft  Pilot’s  Associate  are  ttre  two  key  technoio^es  that  vriN  be 
demonstrated  in  the  Hunter  Stand-off  KiSer  Teem  (HSKT)  ACID.  The  AMUST 
Basdme  capadlity  has  been  demonstrated  on  the  AK-64  and  is  planned  for 
integration  into  Lot  #7  Apache  Longbow  (Fy04-FY10).  In  addition,  this  technology 
will  meet  the  Comandie  tteiefine  to  transition  to  RAH^  Block  I  upgrades  (UAV 
Level  4  ControO.  The  Comanche  PM  has  endcxsed  this  tecfmology  in  the  RAH-66 
Technology  Transition  AgreemenL  Furthermore  the  AMl^  techrxfogy  has  been 
identified  tty  ttie  ra  for  a  Product  knprovemteit  for  tie  Anny  Airborne  Command  and 
Control  System  (A2C2S)  Bteddiav^ 
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Rotoreraft  Pilofs  Associate  (BPA):  RPA  Technology  has  baisitioned  into  the 
AMUST  STO  aid  file  HSKT  ACTD  that  will  transition  to  the  fleet  as  noted  atxwe.  In 
addition,  toe  RPA  Techncdogy  has  transitioned  to  toe  DARPA/Air  Force  Unmanned 
Combat  Air  Vehide  (UCAV)  and  toe  Army  Airtxrme  Command  and  Control  System 
(A2C^)Biackhawk. 

Hefcopter  Actwe  Controls  Tedmotoov  (HACH:  PM  Comanche  has  endorsed  HACT 
and  the  flmefine  transition  to  RAH-66  Blodc  I  upgrades  in  the  RAH-66  Technology 
Transition  Agreement 

Rotanr  Wno  Stoidures  Technotoov  (RWreT):  The  technology  has  transtioned 
(Erecfly  into  the  Comanche.  The  Comanche  PM  is  cunerflty  using  the  RWST 
demonstraflon  component  design  as  toe  baseSnestoJCtural  design  for  the  lower 
forward  fuselage  of  the  Comanche.  Furthermore  toe  dedgnirr^rodoiogies  and 
processes  toat  are  devdoped  as  a  part  of  RWCT  continue  to  be  used  by  toe 
prime  manufacturer  biaH  future  product  designs.  The  contractor  is  in  the  process  of 
tnstitutkmalizHig  flie  design  process  and  metoodotcgies  throughout  toe  company, 
which  will  ben^  bmh  their  mffitary  and  cotranetcial  customers. 

Rotor  Drive  System  for  the  21st  Century  fRDS-21t:  PM  Comanche  has  endorsed 
RDS-21  in  toe  RAH-66  Techndc^  Transition  Agreement  lnadi£tion,the 
technology  wifl  feed  flie  dev^opmort  (rf  the  DARPA/AfMY  Itomanned  Cwnbat 
Anned  Reflorcraifl  (UCAR). 

Preddon  Guided  Mortar  Munitkm  (PGMMi:  PM  Mortars  has  received  FY02 
Congressional  funding  for  the  Component  Advanced  Development  program  as  part 
of  PGMM  and  there  is  tending  torSDD  in  the  POM  starting  in  FY04.  PM  Mortars  has 
agreed  to  the  ATD  exit  level  TRLs. 

Objective  Individual  Combat  Weapon  fOICW  System:  PM  Objective  Indlwduat 
Combat  Weapon  has  endorsed  the  OICW  Systems  Eitoancwnent  STO  and  has 
concurred  that  toe  TRLs  and  the  m^rics  as  stated  to  the  STO  charts  are  toe  a^eed 
upon  program  e)dt  critoria. 


Deputy  Assistant  Secretary 
(Research  and  Tedmoiogy) 
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